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Abstract 

We show that the 3 user Mr x Mn MIMO interference channel where each transmitter is 
equipped with Mt antennas and each receiver is equipped with Mji antennas has d{M, N) = 
min 2+1/k ) degrees of freedom (DoF) normalized by time, frequency, and space dimen- 

sions, where M = min(MT, Mr), N = max(MT, Mr),k = fiyziwl • While the DoF outer bound 
of d{M,N) is established for every Mt-.Mb value, the achievability of d{M,N) DoF is estab- 
lished in general subject to a normalization with respect to spatial-extensions, i.e., the scaling 
of the number of antennas at all nodes. Specifically, we show that qd{M, N) DoF are achievable 
for the qMt x qMfi MIMO 3-user interference channel, for some positive integer q which may 
be seen as a spatial-extension factor, q is the scaling factor needed to make the value qd{M, N) 
an integer. Given spatial-extensions, the achievability relies only on linear beamforming based 
interference alignment schemes and requires neither channel extensions nor channel variations 
in time or frequency. In the absence of spatial extensions, it is shown through examples how 
essentially the same interference alignment scheme may be applied over time-extensions over 
either constant or time-varying channels. The central new insight to emerge from this work is 
the notion of subspace alignment chains as DoF bottlenecks. The subspace alignment chains are 
instrumental both in identifying the extra dimensions to be provided by a genie to a receiver 
for the DoF outer bound, as well as in the construction of the optimal interference alignment 
schemes. 

The DoF value d{M, N) is a piecewise linear function of M, N, with either M or N being the 

bottleneck within each linear segment while the other value contains some redundancy, i.e., it 
can be reduced without reducing the DoF. The corner points of these piecewise linear segments 

correspond to two sets, A = {1/2, 2/3, 3/4, • • • } and B = {1/3, 3/5, 5/7, • • • }. The set A contains 
all those values of M/N and only those values of M/N for which there is redundancy in both 
M and N, i.e., either can be reduced without reducing DoF. The set B contains all those values 
of M/N and only those values of M/N for which there is no redundancy in either M or A'', 
i.e., neither can be reduced without reducing DoF. Because A and B represent settings with 
maximum and minimum redundancy, essentially they are the basis for the DoF outer bounds 
and inner bounds, respectively. 

Our results settle the question of feasibility of linear interference alignment, introduced 
previously by Cenk ct al., for the 3 user Mt x Mr MIMO interference channel, completely 
for all values of Mt, M^. Specifically, we show that the linear interference alignment problem 
{Mt X Mji, d)^ (as defined in previous work by Cenk et al.) is feasible if and only if d < 
[d(M, N)\ . With the exception of the values M/N e B, and only with that exception, we show 
that for every M/N value there are proper systems (as defined by Cenk et al.) that are not 
feasible. Evidently the redundancy contained in all other values of M/N manifests itself as 
superfluous variables that are not discounted in the definition of proper systems, thus creating 
a discrepancy between proper and feasible systems. 

Our results show that M/N E A are the only values for which there is no DoF benefit of 
joint processing among co-located antennas at the transmitters or receivers. This may also be 
seen as a consequence of the maximum redundancy in the M/N e A settings. 



1 Introduction 



The number of degrees of freedom (DoF) of a communication network is a metric of great signif- 
icance as it provides a lens into the most essential aspects of the communication problem. DoF 
investigations have motivated many fundamental ideas such as interference alignment [H [7], de- 
terministic channel models [15], rational dimensions [5l [6], information dimensions [T9], aligned 
interference neutralization [T] and manageable interference [2]. The DoF metric is especially valu- 
able as a first order capacity approximation. Since even the smallest gap between the best available 
DoF inner and outer bounds translates into an unbounded gap in the best available capacity ap- 
proximations, communication networks where DoF values are not known are some of the least 
understood problems, and hence, also the most promising research avenues for significant and 
fundamental discoveries. 

DoF characterizations have recently been obtained for a wide variety of wireless networks. 
Since in this work we are interested primarily in interference channels, it is notable that the DoF of 
interference channels are known when all nodes are equipped with the same number of antennas, for 
almost all channel realizations, and regardless of whether the channels are time- varying, frequency- 
selective or constant. However, if each node may have an arbitrary number of antennas, then a 
general DoF characterization is not available beyond the 2 user interference channel. One obvious 
reason is the explosion of the number of parameters in considering arbitrary antenna configurations. 
However, as we show in this work, the problem involves fundamental challenges even when the 
number of parameters is restricted by symmetry. In particular, the difficulty of this problem has 
to do with the new notion of "depth" of overlap between vector subspaces that comes into play 
on the one hand, and of translating this notion into information theoretic bounds on the other. 
Specifically, in this work we explore what is perhaps the simplest setting for MIMO interference 
channels where the DoF remain unknown, and obtain its DoF characterization, while highlighting 
the challenging nature of the general problem in the process. The assumptions that define our 
primary focus in this work are: 

1. 3-user symmetric MIMO interference channel: The number of users is set to K = 2>, 

the number of antennas at every transmitter is set to the same value, Mt, and the number 
of antennas at every receiver is set to the same value, Mr. Thus, the problem space is 
parameterized by only two variables Mt^Mr. 

2. Spatially-normalized DoF for almost-all channel realizations: The DoF characteriza- 
tions that we seek are intended in the "almost- surely" sense, with channel coefficients drawn 
from continuous distributions. Further, the DoF are normalized not only with respect to time 
and frequency dimensions, but also with respect to the spatial dimension, i.e., we allow chan- 
nel extensions not only in time and frequency dimensions, but also in the spatial dimension 
(i.e., through a scaling of antennas). 

As the smallest, and therefore the most elementary interference channel setting where interference 
alignment becomes relevant, the 3 user interference channel has special significance. The assumption 
of global channel knowledge, as well as the implicit assumption of comparable signal strengths from 
all transmitters at all receivers that follows from the definition of the DoF metric (as opposed to 
Generalized DoF), is most relevant to small clusters of, e.g., no more than 3, mutually interfering 
users. 

The rationale for the remaining assumptions is our interest primarily in generic insights rather 
than the peculiarities and caveats associated with special structures. While the restriction to 



almost-all channel realizations is by now a standard assumption for DoF studies, the normalization 
with respect to spatial dimension is less common. Spatial extension, i.e., proportional scaling of the 
number of antennas at each node and a corresponding normalization of DoF by the same factor, 
is appealing in that it allows us to deal with generic channels, thereby revealing generic insights 
into the geometry of alignments and relative signal space dimensions without having to deal with 
the added complexity of diagonal or block diagonal channel structures that would result from 
channel extensions over constant or time-varying channels, or the rational dimension arguments 
that are often invoked in the absence of sufficient channel diversity. As a further justification for 
the normalization with respect to spatial dimension, we note that so far, for every wireless network, 
with or without multiple antennas, where the DoF characterizations are available for almost-all 
channel realizations, the DoF characterizations are unaffected by spatial normalization. Indeed, we 
conjecture that this should be the case in general, i.e., much like time, and frequency dimensions, 
the DoF of a network (for almost all channel realizations and with global channel knowledge as is 
assumed here) should also scale with the proportional scaling of the spatial dimension. Notably, 
the general question of the scaling of DoF with spatial dimension appears as an open problem 
in ^20j. Also notable is the use of spatial normalization to characterize the DoF region for the 
general MIMO 2 user X channel setting in one of the earliest works on interference alignment 
[3]. Finally, as explained towards the end of this paper through several examples, the interference 
alignment solutions developed in this work under spatial extensions may be directly applied to time 
and/or frequency extensions as well to obtain the same DoF characterizations but without relying 
on spatial extensions. 

2 Background 

We are interested in both the information theoretic DoF of MIMO interference channels, as well as 
the feasibility of linear interference alignment schemes. We start with a summary of relevant work 
on these topics. 

2.1 DoF of MIMO Interference Channels 

The two user (K = 2) MIMO interference channel, where User 1 has Mi transmit and A'^i receive 
antennas, and User 2 has M2 transmit and N2 receive antennas, is shown by Jafar and Fakhered- 
din in [IT] to have min(Mi + M2, A^i -f Ar2, max(Mi, iV2), max(M2, iVi)) DoF. For this result, the 
achievability is based on linear zero forcing beamforming schemes, and the converse is based on DoF 
outer bounds for the multiple access channel obtained by providing enough antennas to a receiver 
so that after decoding and subtracting its own signal, it is able to also decode the interfering signal. 

In [7], Cadambe and Jafar introduced an asymptotic interference alignment scheme, referred to 
as the [CJ08] scheme (see [2D] for an intuitive description of the [CJ08] scheme), leading to the result 
that in the K-user MIMO interference channel, each user can access half-the-cake in terms of DoFQ 
for a total DoF value of KM/2 DoF, almost surely, when all nodes are equipped with the same 
number of antennas Mt = Af/; = M and when channels are time-varying or frequency-selective. In 
[22], Motahari et al. introduced the rational dimensions framework based on diophantine approx- 
imation theory wherein the [CJ08] scheme is again applied to establish the same DoF result, but 
with constant channels and without time/frequency extensions. For the 3-user MIMO interference 
channel setting with Mt = Mr = M > 1, Cadambe and Jafar also present a closed form linear 



^The "cake" refers to the maximum DoF accessible by a user when all interfering users are absent. 



beamforming solution in [7] that requires no time-extensions for even M and 2 time-extensions 
for odd M, to achieve the DoF outer bound value of M/2 per user, without the need for channel 
variations in time/frequency. The DoF outer bound in each of these cases is based on the pairwise 
outer bounds for any two users, as established previously for the single antenna setting, M = 1, 
by Host-Madsen and Nosratinia in [21] and for the multiple antenna setting, M > 1, by Jafar and 
Fakhereddin in 

In [9], Gou and Jafar studied the DoF of the X-user Mt x Mr MIMO interference channel 
under the assumption that rj = max{MT, Mr)/ mm{MT, Mr) is an integer and showed that each 
user has a fraction of the cak^ for a total DoF value of K mm{MT, Mr):^^, almost surely, 
when the number of users K > ij. 

Example: The 3-user 1x2 MIMO interference channel, i.e., the interference channel with 3 
users where each transmitter has 1 antenna and each receiver has 2 antennas, has 2/3 DoF per 
user, as does the 3-user 2x1 MIMO interference channel. The results holds for more than 3 users 
as well, i.e., the K-user 1x2 and 2x1 interference channels have 2/3 DoF per user, for all K > 3. 

The results of [9j, established originally over time- varying/frequency-selective channels, are 
extended to constant channels without the need for channel extensions, by Motahari et al. in [6], 
by employing the rational dimensions framework. Further, Motahari et al. show that each user 
in the K-user Mt x Mr MIMO interference channel, has a fraction of the cake, even when 

V = is not an integer, provided the number of users K > — ^J^.t^'^/l , • Interestingly, the 

' mm{MT,MR) fa !K — gcd(AfT,Afji) ^ 

achievability of min(M7^, Mr) DoF per user, or equivalently ^^.^^^ DoF per user, follows from 

the application of the [CJ08] scheme for every Mt, Mr value, and for any number of users K, and 

requires no joint signal processing between the multiple receive (transmit) antennas at any receiver 

(transmitter). However, the optimality of these achievable DoF has been shown only when either 

r? is an integer and K > rj or when K > — ^jj^,^^?^, for any n. The outer bounds in each of these 

gca(AfT,Afi{) 

cases are based on allowing full cooperation among groups of transmitters/receivers and applying 
the DoF outer bound for the resulting 2-user MIMO interference channel previously derived by 
Jafar and Fakhereddin in [llj. 

Example: Consider the 5-user 2x3 MIMO interference channel. Allowing full cooperation 
between users 1, 2, 3 and allowing full cooperation between users 4,5, we have a resulting two user 
MIMO interference channel where the effective User 1 has 6 transmit and 9 receive antennas, and 
the effective User 2 has 4 transmit and 6 receive antennas. According to the DoF result for 2-user 
MIMO interference channel shown by Jafar and Fakhereddin in this channel has 6 DoF. Since 
cooperation cannot reduce the total DoF, it follows that the original 5 user 2x3 interference channel 
has no more than 6/5 DoF per user. Since MtMr/ {Mt + Mr) DoF are always achievable per 
user, 6/5 is the optimal value of DoF for this channel. Further, since DoF per user cannot increase 
with the number of users, 6/5 is the optimal value of DoF per user in the K user 2x3 MIMO 
interference channel for all K > 5. The same conclusion applies in the reciprocal 3x2 MIMO 
setting as well. 

Note that the DoF value of the 2 x 3 or the 3x2 MIMO interference channel is not known if the 
number of users, K, is 3 or 4. As a special case of our results in this work, we will show that 6/5 
is the optimal DoF value per user in the 2 x 3 or 3 x 2 MIMO interference channel for all > 2, 
thereby resolving the DoF value for all K in the 2x3 and 3x2 settings. Since outer bounds based 
on full cooperation are not enough, the challenge in this case will be to identify the genie signals 
that will lead us to this conclusion. 



^Here, the "cake" corresponds to rmn{MT, Mr) DoF. 



2.2 Feasibility of Linear Interference Alignment 



While the DoF of MIMO interference channels are of fundamental interest, the achievable schemes 
are often built upon theoretical constructs such as the rational dimensions framework or Renyi 
information dimension, whose physical significance and robustness is not yet clear. On the other 
hand, linear beamforming schemes are well understood based on the abundance of MIMO literature. 
As a consequence, there is much interest in the DoF achievable through linear beamforming schemes, 
i.e., through linear interference alignment schemes. A central question in this research avenue is 
the feasibility (almost surely) of linear interference alignment based on only spatial beamforming, 
i.e., without the need for channel extensions or variations in time/frequency/space. The feasibility 
problem is introduced by Gomadam et al. in [23], where iterative algorithms were proposed to 
test the feasibility of desired alignments. Recognizing the feasibility problem as equivalent to the 
solvability of a system of polynomial equations, Cenk et al. in [12] draw upon classical results in 
algebraic geometry about the solvability of generic polynomial equations, to classify an alignment 
problem as proper if and only if the number of independent variables in every set of equations is at 
least as large as the number of equations in that set. While the polynomial equations involved in 
the feasibility of interference alignment are not strictly generic, Cenk et al. appeal to the intuition 
that proper systems are likely to be feasible and improper systems to be infeasible. For a K user 
Mt X Mr MIMO interference channel where each user desires d DoF, denoted as the {Mt x Mji, d)^ 
setting, Cenk et al. identified the system as proper if and only if 

d < ^^ + ^^ (1) 
K + 1 ^ ' 

The conjectured correspondence between proper/improper systems and feasible/ infeasible sys- 
tems is settled completely in one direction, and partially in the other direction, in recent works by 
Bresler et al. in [13] and Razaviyayn et al. in [Tl], who show that: 

1. Improper systems are infeasible |131 114j. 

2. If Mt, M/j are divisible by d then proper systems are feasible |14j . 

3. For square channels, Mt = Mr, proper systems are feasible [13j- 

While the properness of a system seems to work fairly well as an indicator of the feasibility of 
linear interference alignment in most cases studied so far, it is also remarkable that based on 
existing results it is possible to find examples of proper systems that are not feasible. For example, 
consider the 3 user interference channel where (M, N) = (4, 8) and where each user desires d = 3 
DoF. According to ([T]) this is a proper system, and according to [9] it is infeasible because the 
information theoretic DoF outer bound value for this channel is only 8/3 per user. The DoF 
outer bound is easily found by allowing two of the users to cooperate fully, so that the resulting 
2 user MIMO interference channel with (Mi, iVi, M2, A''2) = (8, 16, 4, 8) has a total DoF value of 8 
according to [TT]. Since cooperation does not hurt, and linear schemes (or any other scheme for 
that matter) cannot beat an information-theoretic outer bound, it is clear that the (4 x8,d)^ linear 
interference alignment problem is infeasible for d > 8/3, and in particular for d = 3. 

The observation that some proper systems are not feasible is also made by Cenk et al. in |12j 
who suggest including known information theoretic DoF outer bounds to further expand the set of 
infeasible systems. Interestingly, so far, all known DoF outer bounds for K user MIMO interference 
channels come directly from the DoF result for the 2 user MIMO interference channel [H], applied 



after allowing various subsets of users to cooperate, while eliminating other users to create a 2 user 
interference channel (as also illustrated by the preceding example). As we show in this work, these 
DoF outer bounds do not suffice, even for the symmetric 3 user MIMO interference channel for all 
Mt,Mji values. Thus, the feasibility of proper systems remains an open problem in general, even 
if restricted to the 3 user setting. 

In this work, for the 3 user Mt x MIMO interference channel, we settle the issue of feasibility 
of linear interference alignment. Somewhat surprisingly within this setting, especially considering 
systems near the threshold of proper/improper distinction, we show that most proper systems are 
infeasible. 



3 System Model and Metrics 



We consider a fully connected three-user MIMO interference channel where there are Mt and Mpt 
antennas at each transmitter and each receiver, respectively. As shown in Fig. [T| each transmitter 
sends one independent message to its own desired receiver. Denote by H^j the Mpt x Mt channel 
matrix from transmitter i to receiver j where i,j £ {1,2,3}. We assume that the channel coefficients 
are independently drawn from continuous distributions. While our results are valid regardless of 
whether the channel coefficients are constant or varying in time/frequency, we will assume the 
channels are constant through most of the paper. Global channel knowledge is assumed to be 
available at all nodes. 

At time index t G Z+, Transmitter i sends a complex- valued Mt x 1 signal vector Xi(t), which 
satisfies an average power constraint y X^^i < for T channel uses. At the receiver 

side. User j receives an Mji x 1 signal vector Yj{t) at time index t, which is given by: 



Yj{t) = Y,iijMt) + Zj{t) 



i=l 



where Zj(t) an Mr x 1 column vector representing the i.i.d. circularly symmetric complex additive 
white Gaussian noise (AWGN) at Receiver j, each entry of which is an i.i.d. Gaussian random 
variable with zero-mean and unit- variance. 
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Figure 1: Three- User Interference Channel 



Let Rk{p) denote the achievable rate of User k where p is also referred to as the Signal-to- 
Noise Ratio (SNR). The capacity region C{p) of this network is the set of achievable rate tuples 
R{p) = {Ri{p), R2{p), Rsip)), such that each user can simultaneously decode its desired message 
with arbitrarily small error probability. The maximum sum rate of this channel is defined as 
Rt,{p) = ™&x/j(p)eC(p) X]fc=i -^ik(p)> ^'^d R{p) = R^{p)/S denotes the maximum rate normalized 
per user. The sum DoF are defined as dj:{MT, Mr) = limp^oo Rt.{p) / log(/9), and DoF(Mt, Mr) = 
dj:{MT, Mji)/3 stands for the normalized DoF per user. Throughout this paper, we also write 
DoF{Mt, Mr) as d(MT, Mr) for simplicity. Moreover, we use dk{MT, Mr) to denote the number 
of DoF associated with User k, and the user index k is interpreted modulo 3 so that, e.g.. User 
is the same as User 3. Furthermore, we define the degrees of freedom normalized by the spatial 
dimension, DoFs(-Mt, Mr) as 

fnj M \ dj:{qMT,qMR) 

DoFj:[Mt,Mr) = max — ^ 

qez+ q 

and DoF(Mt, Mr) = DoFs(Mr, Mr)/3 is similarly defined. The dependence on Mt,Mr may be 
dropped for compact notation when no ambiguity would be caused, i.e., instead of T)of{Mt, Mr) 
we may write just DoF. 

Notation: For the matrix A, A(i, :) and A{:,j) denote its i*^ row and j*'* column vector, 
respectively; A{i,m : n) denotes alx(n — m + 1) row vector obtained from the z*'* row and 
the m*^ to n*'^ columns of the matrix A; A(m : n, :) denotes a matrix obtained from the m^^ 
to n*^ rows of the matrix A. We use the notation o{x) to represent any function f{x) such that 
lim^^^oo f{x)/x = 0. Further, we define M = min(MT, Mr), N = max(MT, Mr). 

4 Main Results 

In order to present the DoF results for the 3-user Mt x Mr MIMO interference channel in a compact 
form, let us define the quantity DoF* as follows. 

Definition 1 

DoF* t minf^,^l (2) 
where M = min(MT, Mr), N = max(MT, Mr), k = ■ 

The quantity k denotes the length of the subspace alignment chain, to be described in the next 
section. Clearly, as A'^ and M become approximately equal, i.e., k becomes large, DoF* converges 
to the "half the cake" value, M/2. 

To arrive at the main result of this paper, we proceed through two intermediate results, presented 
here as lemmas. 

Lemma 1 (Outer Bound) For the 3-user Mt x Mr MIMO interference channel, the DoF value 
per user is bounded above as: 



DoF < DoF* 



(3) 



The proof of Lemma [T] is presented in Section |6] and Section [7j 

Remark: Note that the outer bound holds for arbitrary values of MtjMfi, without any spatial 
normalization. However, also note that the outer bound does scale with spatial dimension, e.g., if 
we double the number of antennas at each node the value DoF* would be doubled as well. In other 
words, the outer bound holds both with and without spatial normalization. 

Remark: Unlike all previously used DoF outer bounds for MIMO interference channels, this 
outer bound does not follow from allowing cooperation among groups of users. Instead, what is 
needed is a careful choice of genie signals that provide a receiver access to parts of the signal space 
originating at interfering transmitters. Precisely which parts of a signal space can be provided as 
side information to produce the tight DoF outer bounds, is perhaps the most challenging technical 
aspect that we deal with in this paper. As such, the outer bounds represent the most significant 
contribution and a majority of this paper is devoted to their derivation. 

Lemma 2 (Inner Bound) For the 3-user Mt x Mr MIMO interference channel, the DoF per 
user value [DoF^^J is achievable with linear beamforming over constant channels without the need 
for symbol extensions in time, frequency or space. 

The proof of Lemma [2] is presented in Section |8| 

Remark: Note that the achievability result stated in Lemma [2] is limited to integer values of 
DoF. Typically, the issue of achievability for non- integer values of DoF is resolved by using symbol 
extensions over time or frequency dimensions, often with the need for time- varying/frequency- 
selective channels to create sufficient diversity. Time/frequency extensions can be used here as 
well, as will be discussed in Section [8. 3[ However, since our primary interest is in generic channels 
rather than the structured (block-diagonal) channels that result from time/frequency extensions, 
we will focus on spatial extensions instead. 

Lemma [T] and Lemma [2] lead us immediately to our main results, stated as theorems. 

Theorem 1 (Spatially-Normalized DoF) For the 3-user Mt x Mji MIMO interference chan- 
nel, the spatially-normalized degrees of freedom value per user is given by: 

DoF = DoF* (4) 

Proof: The proof of Theorem [T] follows directly from Lemma [T] and Lemma [2j Clearly, whenever 
DoF* is an integer, we have an exact DoF characterization, DoF = DoF*, without the need for any 
spatial extensions. For the cases where DoF* is not an integer, let us express it in its rational form 
p/q. Then, scaling the number of antennas by q, we have a 3 user qM^ x qMji MIMO interference 
channel, for which the value DoF* = p is both achievable and an outer bound, i.e., it is optimal. 
Since the normalized DoF outer bound is not affected by spatial scaling, no other spatial extension 
can improve the spatially- normalized DoF, and we have the result of Theorem [l] ■ 



To understand the result of Theorem [T| the following equivalent, but more explicit representation 
of DoF will be useful: 
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or in compact form: 
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(6) 



While Theorem [T] allows spatial extensions to avoid dealing with structured channels resulting 
from symbol extensions in time/frequency, our results are not limited to settings with spatial 
extensions. As we illustrate through numerous examples, the achievable schemes translate directly 
from spatial extensions to channel extensions over time/frequency dimensions instead. With few 
exceptions, these channel extensions do not require channel variations in time/frequency. A sample 
of our DoF results, without spatial extensions appears in Fig. [2] 

Lastly, we consider the most restricted setting where only linear alignment schemes are allowed, 
and no channel extensions are allowed in time/frequency/space. The next theorem settles the issue 
of feasibility of linear interference alignment for the 3 user My x Mji MIMO interference channel. 



Theorem 2 (Feasibility of Linear Interference Alignment) For the 3-user Mtx Mji MIMO 
interference channel, the DoF demand per user, d, is feasible with linear interference alignment if 
and only if d < DoF*. 

Remark: Note that the feasibility of linear interference alignment is intended here in the same 
sense as studied previously by Cenk et al. in [T2], Bresler et al. in and Rezaviyayn et al. in 
|14j . i.e., without symbol extensions in time/frequency/space. 

Proof: The proof of Theorem [2] also follows directly from Lemma [T] and Lemma [2| Since the 
feasibility of linear interference alignment only concerns integer values of DoF per user, where 
the inner and outer bounds are tight, and the inner bound is achievable with linear interference 
alignment without the need for symbol extensions in time, frequency or space, the result of Theorem 
[2] follows immediately, and will be presented in Section [874| in detail. ■ 



5 Understanding the Result 

In this section we provide an intuitive understanding of the main results based on linear dimen- 
sion counting arguments, specifically by introducing the notion of subspace alignment chains, and 
highlight the key observations that follow from the main results. 
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Figure 2: DoF per User (without space-extensions) of the Three-User Mj- x Mr MIMO Interference 
Channel 



5.1 The Simple Cases: M/N < 1/2 and M = N 

li M = N, then the DoF are already known, corresponding to the half-the-cake value reported in 

If < M/N < 1/2, i.e., 2M < N, then interference ahgnment is not required. Consider first 
the setting < M/N < 1/3, i.e., 3M < N. Here, if 3Mt < M/j then each receiver has enough 
antennas to zero force all interference at no cost to desired signals, and if 3Mr < Mt then each 
transmitter has enough antennas to zero force all unintended receivers. Therefore, in this case every 
user achieves all of the cake, i.e., his interference- free DoF, M. 

Next, consider the case 1/3 < M/N < 1/2, i.e., 2M < N < 3M. Allowing any two users to 
cooperate, and using the DoF result for the resulting 2 user MIMO interference channel, we find 
the total DoF outer bound value of A^. This value is easily seen to be achievable with only zero 
forcing at the receivers (M/j > Mt) or at the transmitters (Mt > Mji), e.g., with users 1 and 2 
achieving M DoF each and the third user achieving — 2M DoF. Note that the DoF assigned to 
each user can always be made equal by equal time-sharing between all permutations of the users 
for a given DoF allocation. 

For the remaining cases, i.e., 1/2 < M/N < 1, it turns out we need interference alignment. The 
challenge lies not only in constructing interference alignment schemes for this setting, but also, and 
to a greater extent, in finding the required DoF outer bounds. A new notion that emerges in this 
setting and that plays a central role in limiting the DoF values, is the notion of subspace alignment 
chains, which is introduced next. 



5.2 Subspace Alignment Chains 

The main DoF outer bound, presented in Lemma [T| consists of two outer bounds. 



N 

We will refer to these bounds as the A^-bound and the M-bound, respectively. The parameter k that 
appears in both bounds, is the length of the subspace alignment chain, a notion to be introduced 
in this section. Note that the first outer bound value is limited by N and is an increasing function 
of At while the second outer bound value is limited by M and is a decreasing function of k. The 
significance of this will become clear in the following description. 



5.2.1 The A^-bound: DoF < t^^N 

Consider the first outer bound, DoF < 2k+i -^' Since linear dimension counting arguments are 
identical for reciprocal networks |23j, without loss of generality let us focus on the setting Mt < Mr, 
so that M = Mt,N = Mr. Now, since each receiver has at least as many antennas as any 
transmitter, zero-forcing of signals by the transmitters is not possible. Since interference cannot 
be eliminated, the next best thing is to align interference. Ideally, since each transmitter causes 
interference at two receivers, it should align with another interference vector at each of those 
undesired receivers. For example, let us consider a vector sent by Transmitter 1 that causes 

interference at Receiver 2. This vector should align with a vector ^^i) sent by Transmitter 3, 
which is also undesired at Receiver 2. Now, the vector ^Iso causes interference at Receiver 1, 

so it should align there with a vector V2(i) sent by Transmitter 2. The vector V2(i) in turn also 
causes interference to Receiver 3, so it should align with a vector ^i{2) sent from Transmitter 1. 
Continuing like this, we create a chain of desired alignments: 

r Rx 2 r Rx 1 1 r Rx 3 7- Rx 2 r Rx 1 ^ Rx 3 

Vi(i) ^ V3(i) ^ V2(i) ^ Vi(2) ^ V3(2) ^ V2(2) ^ • • • 

The main question is whether this ideal scenario is possible, i.e., can we extend this subspace 
alignment chain indefinitely? Consider, for example the setting M = N that is previously solved 
by Cadambe and Jafar in Cadambe and Jafar create this infinite chain of alignments using 
the asymptotic alignment scheme for M = N = 1 and implicitly create an infinite alignment chain 
in the non-asymptotic solution for, e.g., M = = 2, as the chain closes upon itself to form a 
loop, i.e., Vx(i) = Vx(2). The chain closes upon itself mainly because in this setting (as well as 
all cases where M = N > 1) the optimal signal vectors are eigenvectors of the cumulative channel 
encountered in traversing the alignment chain starting from any transmitter and continuing until 
we return to the same transmitter. Thus, as shown by Cadambe and Jafar [7], the ideal solution 
of perfect alignment, achieved by an infinite (or closed-loop) alignment chain, is possible when 
M = N. 

When M 7^ A^, it turns out that the subspace alignment chain can neither be continued indef- 
initely, nor be made to close upon itself. The length of the subspace alignment chain is therefore 
limited to a finite value k that is a function of M and A^. The limited length of the subspace 
alignment chain creates the bottleneck on the extent to which interference can be aligned, and is 
ultimately the main factor limiting the DoF value. 




(a) 1/2 < M/N < 2/3, Chain length k = 2 (b) 3/4 < M/N < 4/5, Chain length k = 4 

Figure 3: Subspace alignment chains leading to the A^-bound, DoF < 2k+i -^ P^^ user. Dashed 
arrows indicate unaligned interference. Numbered signal spaces shown in black ovals indicate the 
position of the signal space in the alignment chain. The directions of the solid arrows indicate the 
progression of the alignment chain. 



Consider the setting 1/2 < M/N < 2/3, as shown in Fig. ^|a) , from a linear dimension counting 



perspective. Users 1, 2, and 3 are shown in green, yellow and blue in the figure. Let us start our 
subspace alignment chain with a signal space at Transmitter 1, shown in the figure as a black oval 
with the number 1. Consider the alignment that can occur at Receiver 3 with a corresponding signal 
space (marked with the number 2 to indicate the second signal in the alignment chain) originating 
at Transmitter 2. Note that interference can be aligned at each receiver only within that subspace 
which is accessible from both interfering transmitters. Since each transmitter can access only a 
M dimensional subspace of the dimensional signal space available to Receiver 3, and because 
generic subspaces do not overlap any more than they have to, it follows that the size of the signal 
space accessible from both Transmitters 1 and 2, where interference alignment can take place, is 
no more than M + M- N = 2M-N dimensional. Since 1/2 < M/N, we note that 2M - N is 
a positive number, i.e., such a space exists. However, the accounting for aligned dimensions does 
not stop here. Let us continue the alignment chain to see if further alignment is possible. The 
2M — N dimensional signal space 2 originating at Transmitter 2, can align with a corresponding 
signal space from Transmitter 3 at Receiver 1, in no more than (2M — N) + M — N = 3M — 2N 
dimensions. However, since M/N < 2/3, we note that 3M — 2N is not a positive number, i.e., such 
a space does not exist. Thus, the alignment chain must stop here, and the maximum length of the 
alignment chain is k = 2, representing the number of transmitted signal spaces that participate in 
the alignment chain. Now, to find corresponding DoF outer bound, let us account for the signal 
space dimensions. Fig. ^^[a) may be helpful here. Assuming each transmitted signal space is do 



dimensional, the total number of dimensions transmitted is do + do = 2do, and the number of 



dimensions occupied by interference at all three receivers is do + do + do = 3do- Since the desired 
signal spaces must remain distinct from interference, the sum of desired signal dimensions at all 
receivers is 2do. Thus, the total number of receive dimensions needed to accommodate both the 
desired signals and the interference is at least 5do. Since the total number of receive dimensions 
available is 3A^ we must have 5do < 3A^, i.e., do < 3A^/5. Since the total number of transmitted 
dimensions per user is 2do/3, we have the corresponding outer bound value, DoF < 2N/5 per user, 
which corresponds to 2k+i ^' ^ expected. 

As the next example, consider the setting 3/4 < M/N < 4/5, shown in Fig. \3i\h)\ Again, we 
start our alignment chain with the subspace numbered 1 at Transmitter 1. As seen from Receiver 
3, this space can align with a corresponding signal space (numbered 2) originating at Transmitter 
2, in no more than 2M — N > dimensions. Continuing the chain, the next alignment must occur 
at Receiver 1, where the 2M — N dimensional space (numbered 2) originating at Transmitter 2, can 
align with a corresponding signal space (numbered 3) originating at Transmitter 3, in no more than 
{2M-N)+M-N = 3M-2N dimensions, which is also a positive number since M/N > 3/4 > 2/3, 
i.e., such a space exists. At this point the alignment chain has length 3. Continuing it further we 
note that the next alignment must occur at Receiver 2, where the 3M — 2A^ dimensional space 
(numbered 3) originating at Transmitter 3 can align with a corresponding signal space (numbered 
4) originating at Transmitter 1, in no more than (3M — 2A^) -\- M — N = 4M — 3A^ dimensions, 
which is also a positive number since M/N > 3/4, i.e., such a space exists. Now the length of the 
alignment chain is 4. In order to continue the alignment chain further, we next consider Receiver 3, 
where the 4M — 3A^ dimensional space (numbered 4) originating at Transmitter 1 can align with a 
corresponding space originating at Transmitter 2 in no more than (4M — 3A^) + M — N = 5M — 4A^ 
dimensions, which is not a positive number since M/N < 4/5, i.e., such a space does not exist. 
Thus, the alignment chain ends here, and the maximum length of the alignment chain is k = 4 
for this example. Now, lets compute the implied DoF outer bound. Assuming each transmitted 
signal space is do dimensional, the total number of dimensions transmitted is 4do, and the number 
of dimensions occupied by interference at all three receivers is 5do- Including the desired signal 
dimensions which must remain distinct from interference, the total number of receive dimensions 
needed is at least 4do + 5do = Qdo- Since the total number of receive dimensions available is 3A^ we 
must have 9do < 3A^, i.e., do < A^/3. Since the total number of transmitted dimensions per user is 
4do/3, we have the corresponding outer bound, DoF < 4A^/9 per user, which again corresponds to 
2k+i ^ expected. 

These examples can be generalized in a straightforward manner, to verify that for the setting 
2^ < ^ < the length of the subspace alignment chain n = p, which can also be expressed 

8iS K = The corresponding outer bound value is calculated as follows. A total of Kdo 

dimensions are transmitted, creating interference spaces of total dimension (k + l)do- The desired 
signal and interference together need a total of Kdo + {n + l)do = {2k + l)do dimensions. Since 
only 3A^ dimensions are available, we must have do < 2kTT" since the number of dimensions 

transmitted per user is Kdo/ 3, we have the A^-bound, DoF < 2^j^N . 

We make an interesting comparison between the subspace alignment chains introduced above 
and the work of Bresler and Tse in Bresler and Tse considered linear interference alignment 
problem for a three-user SISO Gaussian interference channel with time- varying/frequency-selective 
channel coefficients when the maximum diversity order that the channel can provide, e.g., the 
number of sub-carriers, is limited to L. They show that the maximum DoF achievable per user 
through linear interference alignment is a strictly increasing function of L that monotonically 
converges to the information theoretic outer bound value of 1/2 as L approaches infinity. Finite 



length chains of ahgned vectors appear in the derivation of Bresler and Tse's result as well. However, 
in spite of this superficial similarity, the alignment chains used by Bresler and Tse are fundamentally 
different from the subspace alignment chains in this work. First, the alignment chains of Bresler and 
Tse identify the limitations of DoF achievable through linear interference alignment schemes, but 
it is known that these limitations are surpassed by rational alignment schemes [6j that can achieve 
the information theoretic outer bound value of 1 /2 without the need for any channel variations. On 
the other hand, the subspace alignment chains presented in this work are much more fundamental 
in that they identify information theoretic outer bounds, i.e., these bounds cannot be beaten by 
linear alignment, rational alignment or any other scheme to be invented in the future. Second, 
the alignment chains in Bresler and Tse's work reach their maximum length when it becomes 
impossible to separate the desired signal from interference. Alignment of interference, per se, is 
not a challenge in their setting. On the other hand, the subspace alignment chains discussed above 
reach their maximum length when it becomes impossible to align interference any further. Keeping 
the desired signal separate from interference is not the main concern in our setting. 



5.2.2 The Af-bound: DoF < 

Here we explain the second outer bound, DoF < ^^jrjAf , from linear dimension counting arguments. 
Since linear dimension counting arguments are identical for reciprocal networks [23j, without loss 
of generality let us focus on the setting Mt > Mji, so that M = Mr,N = Mt- Now, since each 
transmitter has more antennas than any receiver, zero-forcing of signals by the transmitters is 
possible. Ideally, we would like to zero force all interference. However, since Mt < 2M/j, it is not 
possible for any transmitter to simultaneously zero-force its transmitted signal to both unintended 
receivers. The next best thing is to zero-force interference to the extent possible, and then align 
the remaining interference that cannot be zero-forced. This observation gives rise to a slightly 
different type of subspace alignment chains. The two ends of the alignment chain correspond to 
transmitted signals that are zero forced at one unintended receiver and cause interference at the 
other unintended receiver. These two non-zero- forceable interference terms are connected through a 
subspace alignment chain to alleviate the impact of the non-zero-forceable interference. Since zero- 
forcing is preferable to interference alignment, smaller interference alignment chains are preferable. 
Therefore, in this case, we will be limited by how quickly the semi-zero- forced signals can be 
connected through a subspace alignment chain. Therefore, this perspective gives rise to an outer 
bound 2k-i -^ which is a decreasing function of the length of the subspace alignment chain. 

Consider the setting 1/2 < M/N < 2/3, illustrated in Fig. -^[a)[ We start the alignment chain 



at Transmitter 1, where the number of transmitted dimensions that can be zero- forced at Receiver 
2 is no more than — M. Since N — M < M, these dimensions cannot be simultaneously zero- 
forced at Receiver 3. This creates the non-zero-forceable interference at Receiver 3 which initiates 
the subspace alignment chain. Recall that we would like the alignment chain to be as short as 
possible. This means that ideally, we would like the next signal in the chain (marked as number 2 
in the figure), which must originate at Transmitter 2, to simultaneously accomplish the following 
objectives: 

1. Signal space 2 should align with pre-existing interference at Receiver 3. 

2. Signal space 2 should be zero- forced at Receiver 1. 



Note that if it is possible to accomplish these objectives, signal 2 would not increase the interference 
space at any undesired receiver, which is why this is the preferred goal in choosing signal space 2. 




(a) 1/2 < M/N < 2/3, Chain length k = 2 (b) 2/3 < M/N < 3/4, Chain length k = 3 

Figure 4: Subspace alignment chains leading to the M-bound, DoF < j^r^jM per user. Dashed 
arrows indicate zero-forced interference. Numbered signal spaces shown in black ovals indicate the 
position of the signal space in the alignment chain. The directions of the solid arrows indicate the 
progression of the alignment chain. 

Let us see if this is possible. At Receiver 3, interference already spans N — M dimensions, leaving 
an interference free space of M — [N — M) dimensions. For signal space 2 to align with pre-existing 
interference at Receiver 3, Transmitter 2 must zero-force these M — (N — M) interference-free 
dimensions for Receiver 3. In addition, if signal space 2 is to be zero- forced at Receiver 1, then 
another M dimensions must be zero forced. With generic signal spaces, the total number of 
dimensions to be zero forced is M + (M — (A^ — M)). Since Transmitter 2 has only N antennas, 
it leaves N — [M + (M — (N — M))] = 2N — 3M dimensions within which both objectives can be 
accomplished. Since M/N < 2/3, we note that 2N — 3M > 0, i.e., such a space exists and it is 
possible to terminate the alignment chain. The resulting alignment chain length is k = 2. Now, let 
us compute the implied DoF bound. With do dimensions assigned to each transmitted signal space, 
the total number of transmitted dimensions is 2do and the total number of interference dimensions 
is (Iq. Adding up the desired signal dimensions and the interference dimensions (because the two 
must not overlap) we need a total of ScIq dimensions at the three receivers. The total number of 
dimensions at the three receivers is 3M, which gives us the outer bound 3do < 3M, or do < M. 
Since the number of transmitted dimensions per user is 2do/3 we have the outer bound, DoF< 2M/3 
per user, which coincides with j£^M, as expected. 

Next, let us consider the setting 2/3 < M/N < 3/4, illustrated in Fig. |^[b)[ Once again, we 
start the alignment chain at Transmitter 1 and continue up to signal space 2. However, note that 
this time, because 2/3 < M/N, there does not exist a signal space 2 which can be simultaneously 
aligned with interference at Receiver 3 and be zero- forced at Receiver 1. Thus, the alignment chain 
cannot be terminated at length 2. The next best thing is to only achieve interference alignment with 



signal space 2 and extend the subspace alignment chain. Recall that in order to align interference at 
Receiver 3, Transmitter 2 must zero force the M — (N ~ M) dimensional null-space of interference at 
Receiver 3, leaving exactly A^— [M — {N — M)] = 2N — 2M dimensions at Transmitter 2 that satisfy 
the interference alignment requirement. Since 2N — 2M < M, note that the aligned dimensions 
cannot be zero forced at Receiver 1. Thus, the corresponding interference space at Receiver 1 is 
2N — 2M dimensional. Now, we extend the subspace alignment chain to signal space 3, which 
originates at Transmitter 3 (see Fig. |^[b)[ ), and again we check if the alignment chain can be 
terminated. For the alignment chain to end with signal space 3, it must simultaneously satisfy the 
following two objectives: 

1. Signal space 3 should align with pre-existing interference at Receiver 1. 

2. Signal space 3 should be zero- forced at Receiver 2. 

Let us see if this is possible. At Receiver 1, the space accessible by interference produced so far 
occupies no more than 2N — 2M dimensions. Equivalently, an interference-free space of at least 
M — {2N — 2M) dimensions must be maintained at Receiver 1. For signal space 3 to align with 
pre-existing interference at Receiver 1, Transmitter 3 must avoid the interference- free dimensions 
available to Receiver 1, i.e., it needs to zero-force these M — {2N — 2M) interference-free dimensions. 
In addition, if signal space 3 is to be zero-forced at Receiver 2, then another M dimensions must 
be zero forced. With generic signal spaces, the total number of dimensions to be zero forced is 
M + {M - {2N - 2M)). Since Transmitter 3 has only N antennas, it leaves N - [M + {M - 
{2N — 2M))] = 3A^ — 4M dimensions within which both objectives can be accomplished. Since 
M/N < 3/4, 3A^ — 4M > 0, i.e., such a space exists and it is possible to terminate the alignment 
chain. The resulting alignment chain length is k = 3. Now, let us compute the implied DoF bound. 
With do dimensions assigned to each transmitted signal space, the total number of transmitted 
dimensions is 2>dQ and the total number of interference dimensions is 2do. Adding up the desired 
signal dimensions and the interference dimensions (because the two must not overlap) we need a 
total of 5do dimensions at the three receivers. The total number of dimensions at the three receivers 
is 3M, which gives us the outer bound Sdo < 3M, or do < 3M/5. Since the number of transmitted 
dimensions per user is do we have the outer bound, DoF< 3M/5 per user, which coincides with 
2k-i -^' expected. 

Continuing along the same lines, these examples can also be generalized in a straightforward 
manner to verify that for the setting 2zl < ^ the length of the subspace alignment 

chain k = p, which can also be expressed as k = \j^zim] ■ The corresponding outer bound value is 
calculated as follows. A total of Kdo dimensions are transmitted, creating interference spaces of total 
dimension (k — l)(io- The desired signal and interference together need a total of udo + {k + l)do = 
(2k — l)(io dimensions at the receivers. Since only 3M dimensions are available at the receivers, 
we must have do < ^^zi- Now, since the number of dimensions transmitted per user is K(io/3, we 
have the outer bound, DoF < ^^_^ M. 

We conclude this discussion with two plots of the DoF characterization presented in Theorem 

ihown in Fig. s] and Fig. 6 Both figures are plotted as a function of the ratio 7 = M/N. 
Clearly, as M, become less disparate, 7 increases, and the length of the subspace alignment 
chain, /t increases as well, approaching infinity as 7 — )• 1. While the two figures are equivalent, 
the normalization with respect to N in Fig. [5] and the normalization with respect to M in Fig. [6] 
highlight the role of interference-alignment and zero-forcing, respectively. As 7 increases from to 
1, subspace alignment chains become longer, a desirable outcome for interference alignment, which 



is reflected in Fig. [5| On the other hand, as 7 increases from to 1, alignment chains become 
longer, an undesirable outcome for zero forcing, which is reflected in Fig. |6| The interplay between 
the two bounds is evident in the piecewise analytical nature of the DoF function, with either M or 
N being the bottleneck within each analytical segment. A number of interesting observations can 
be made from the DoF result. These observations are the topic of the remainder of this section. 
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5.3 Other Key Observations 

For these observations, we will refer to the DoF characterization in Theorem [T] and its depiction as 
the piecewise linear curve in Fig. [5] 



5.3.1 Redundant Dimensions 



A particularly interesting observation from Q and Fig. [5] is that within each piecewise linear 
interval, the DoF value depends only on either M or A^. This makes the other parameter somewhat 
redundant. In other words, within each piecewise linear section of the DoF curve, either the number 
of dimensions at the transmitter or receiver can be increased/decreased without changing the DoF 
value. For example, consider the 3 user 7 x 10 MIMO interference channel. This channel lies in the 
range 2/3 < M/N < 5/7, where the DoF value 3M/5 depends only on M. Therefore, there is some 
redundancy in A'^. Since the redundant dimensions are fractional, they are much more explicitly 
seen in a larger space. So let us consider the 3 user 35 x 50 MIMO interference channel, which 
is simply a spatially scaled version of the original 7 x 10 setting. Now, we know that the 35 x 50 
setting has exactly 21 DoF (no spatial scaling required, since this is an integer value). However, 
note that the 35 x 49 setting also has only 21 DoF. Incidentally, the 31 x 49 setting achieves the 21 
DoF with only linear beamforming based interference alignment, i.e., without the need for symbol 
extensions in time/frequency/space. Therefore, clearly, the SO*'^ receive antenna is redundant from 
a DoF perspective. 

The previous example illustrates the situation for M/N values that fall strictly inside the piece- 
wise linear intervals. Now let us consider M/N values that fall at the boundary points of the 
piecewise linear intervals. For example, consider the 3 user 10 x 15 MIMO interference channel, 
which corresponds to the M/N value 2/3, i.e., a corner point, and has DoF value 6. However, note 
that the 3 user 9 x 15 MIMO interference channel also has 6 DoF. Thus, the lO*'' transmit antenna 
is redundant from a DoF perspective. Alternatively, consider the 3 user 10 x 14 MIMO interference 
channel, which also has 6 DoF. Thus, evidently, the 15*^ receive antenna is redundant in the 10 x 15 
setting. Thus, one can lose either a transmit antenna or a receive antenna (but not both) without 
losing DoF in the 3 user 10 x 15 MIMO interference channel. This is because the 10 x 15 setting, 
which corresponds to M/N = 2/3, sits at the boundary of two piece- wise linear segments where 
the redundancies in M and the redundancies in A^ meet. Therefore it contains both redundancies. 
The same observation is true for corner points M/N = 2/3, 3/4, 4/5, • • • . 

Now consider the other set of corner values M/N = 1/3, 3/5, • • • . As it turns out, these are 
the only values where neither the transmitter, nor the receiver has any redundant dimensions. We 
summarize the observations below: 

1. For M/N G (0, 1/3), (1/2, 3/5), (2/3, 5/7), • • • , the value of M is the bottleneck, but the value 
of A includes redundant dimensions that can be sacrificed without losing DoF. 

2. For M/N £ (1/3, 1/2), (3/5, 2/3), (5/7, 3/4), ••• , the value of A is the bottleneck, but the 
value of M includes redundant dimensions that can be sacrificed without losing DoF. 

3. For M/N £ A = {1/2, 2/3,3/4,4/5, • • • }, and only for these values, both M and A include 
redundant dimensions, either of which can be sacrificed without losing DoF. 

4. For M/N £ B = {1/3, 3/5, 5/7, 7/9, • • • }, and only for these values, neither M nor A contains 
any redundant dimensions, i.e., reducing either will lead to loss of DoF. 

Thus, the sets A and B represent maximally and minimally redundant settings. The redundancy, 
and the lack thereof, has interesting implications. For instance, the set A corresponds to maximal 
redundancy and is also the precise set of M/N values for which no joint processing is needed among 
the co-located antennas at any transmitter or receiver. On the other hand the set B corresponds to 



no- redundancy, and is also the precise set of M/N values for which all proper systems are feasible 
from a linear interference alignment perspective. Next we elaborate upon these observations. 



5.3.2 The DoF Benefit of MIMO Processing 

In the K-usei MIMO interference channel setting with M = N, i.e., equal number of antennas at 
every node, Cadambe and Jafar have shown [7| that there is no DoF benefit of joint processing 
among multiple antennas, because the network has KM/2 DoF even if each user is split into M 
users, each with a single transmit and single receive antenna and with only independent messages 
originating at each transmitter. For the K user Mx x M/j MIMO interference channel setting, 
Ghasemi et al. have shown in [lOj that ^/^^j^^ = m+n -DoF are achievable even if transmitter is 
split into Mt single-antenna transmitters, each receiver is split into single antenna receivers, 
and there are no common messages. Note that while in general this achievable DoF value is not 
optimal, Ghasemi et al. have shown that ^/^^j^^ is the optimal DoF value per user for the K user 

Mt X Mji MIMO interference channel when the number of users K > ^^:^+^/'. . . Here we make 

gca(MT,MR) 

related observations for our setting. 

1. The 3 user Mt x Mr MIMO interference channel has BoF{Mt,Mr) = Mt+Mr whenever 
M/N G A, i.e., ^ — p+T' -l^ote that this is a statement about regular DoF, i.e., without 
requiring spatial extensions. This is because the outer bound from Lemma [T] matches the 
achievability result of Ghasemi et al. in |10] for these settings. 

2. The K >2 user MtX-Mr MIMO interference channel has DoF(Mt, Mr) = Mt+Mr whenever 
^ = for some p G Z"*". Note that this statement is for any number of users (greater 
than 2), and not just for 3 users. Thus, we have a DoF characterization for any number of 
users whenever ^ = The outer bound holds for any number of users because the DoF 
per user cannot increase with the number of users. The achievability is already established 
for any number of users. Since the two match, we know the DoF for any number of users. 
The result significantly strengthens the previous DoF characterization by Ghasemi et al. in 
|10j . As an example, consider the {M,N) = (2,3) setting. Ghasemi et al. show that the 
this setting has 6/5 DoF per user if the number of users is 5 or higher. However, our result 
shows that this setting has 6/5 DoF if the number of users is 3 or higher. The improvement 
is even more stark for larger values of M, A^. For example, Ghasemi et al. show that the 
setting (M, N) = (9, 10) has exactly 90/19 DoF per user if the number of users is 19 or higher, 
whereas our result shows that this setting has exactly 90/19 DoF if the number of users is 3 
or higher. 

3. There are no DoF benefits of MIMO processing whenever ^ = for p G This can 
be seen as follows. For our result illustrated in Figure [5| the piecewise linear Dof/N curve 
is bounded below by the smooth curve shown with a light solid line plotting the value 

Since 7 = M/N, note that iV;:^ = corresponds to MN/{M + N) DoF, i.e., the 

achievable DoF without any joint processing across multiple antennas, or the DoF achievable 
with independent coding/decoding at each transmit/receive antenna. Since the Bof/N curve 
touches the curve whenever 7 = there is no DoF benefit of MIMO processing in 
these settings. 



4. Conversely, MIMO processing has DoF benefits whenever 7^ for some p £ This is 
because for all these (M, N) values, the DoF curve is strictly above the MN/ (M + N) value. 

5. MIMO processing can enable linear achievable schemes when otherwise asymptotic alignment 
would be needed. We illustrate this with an example. Consider the 3 user 10 x 15 interference 
channel (where M/N = 2/3), which we now know, has 6 DoF per user. We also know from the 
work of Ghasemi et al. that this DoF value can be achieved without any MIMO processing, 
but it requires the [CJ08] asymptotic interference alignment scheme [23] either in the rational 
dimensions framework or over time-varying channels. On the other hand, as we will show in 
this work, the 6 DoF per user can be achieved purely through linear interference alignment 
based on beamforming without requiring any symbol extensions in space, time or frequency, 
by exploiting the MIMO benefit of joint processing among antennas located on the same node. 



5.4 Infeasibility of Proper Systems 

Our DoF results settle the issue of feasibility /infeasibility of linear interference alignment for the 3 
user My x M/j MIMO interference channel. Prior work on this topic is summarized in Section [2j 
As stated earlier, it is known that improper systems are feasible, and also under certain conditions 
proper systems are feasible. The feasibility of proper systems is believed to be much more widely 
true. Somewhat surprisingly, our results show that for the 3 user MIMO interference channel, the 
relationship between proper systems and feasibility of linear interference alignment is very weak, 
in the sense that most proper systems are infeasible. 

Specializing the characterization of proper systems by Cenk et al. [12] to the 3 user Mt x Mpi 
MIMO interference channel, the system is proper if and only if the desired DoF per user 

d < — - (9 
4 

We will say that a system is strictly proper if we have equality in ([o]). In Figure [sj the Hof/N 
curve is bounded above by a solid red line that plots the value Note that this line only 

starts from 7 = 1/3 because for 7 G (0, 1/3) (denoted as the dashed red line) the DoF per user 
is bounded above by the single user bound. This solid red line differentiates proper systems from 
improper systems. All systems above the curve are improper while those below the curve are proper. 
However, the DoF outer bound lies strictly below the curve except when 7 = ^ = for p G Z^. 
Therefore, many proper systems and most strictly proper systems are infeasible. Remarkably, these 
systems are not only infeasible in terms of the restricted goal of achieving the desired DoF values 
through interference alignment with linear beamforming and without relying on channel extensions 
in time/frequency, but also they are infeasible in terms of the much more relaxed goal of achieving 
the desired DoF through any possible achievable scheme, linear or non-linear, using interference- 
alignment or otherwise, using time- varying or constant channels, and using scalar or vector coding. 
This is because the solid blue curve is the information-theoretic DoF outer bound. 

Let us make this observation explicit with a few examples. Consider the (M, A*") = (8, 12) 
setting (where 7 = M/N = 2/3), with desired DoF value d = 5 per user. This is a strictly proper 
system because d = ^^^^ . But from Lemma [l] we know that the information theoretic DoF per 
user for this channel is bounded above by 24/5. Therefore d = 5 is clearly infeasible. Similarly, for 
any value of j ^ B, i.e., that is not of the form one can create an infeasible proper system. 

For example, suppose 7 = 0.61. Equivalently, ^ = 61/100. Choosing (M, A) = (244,400), we 
arrive at the desired DoF value d = ^ = 161 per user which would make the system strictly 



proper. However, we know from Lemma [T] that the information theoretic DoF (per user) outer 
bound for {M,N) = (244,400) is 800/5 = 160. Thus, once again the strictly proper system is 
infeasible. As yet another example consider the choice 7 = 0.74, i.e., ^ = j^. Choose the 
setting (M, A^) = (148, 200) for which the information-theoretic DoF per user is bounded above by 
^ = 85.7.... Therefore, if the desired DoF value per user is 87, the system is strictly proper and 
infeasible, if the desired DoF value per user is 86, the system is proper and infeasible. Proceeding 
similarly, we arrive at the following conclusions. 

1. For every value of 7 except 'j £ B, we can find proper systems that are infeasible, not only in 
terms of linear interference alignment, but also information theoretically infeasible. 

2. For the values 7 G i3, proper systems are always feasible, i.e., the DoF demand d = {M + 
N)/4: per user, which is also the information theoretic outer bound, is actually achiev- 
able with only linear interference alignment, without the need for symbol extensions in 
time/frequency/space. 

These observations, especially the infeasibility of proper systems for M/N = 1/3, 3/5, 5/7, • • • , can 
be understood in terms of the redundant dimensions explained in the previous section. Recall that 
Cenk et al. |12j make the distinction between proper /improper systems based on the number of 
variables involved in the system of polynomial equations. From the observations on redundant 
dimensions, we know that except for M/N = 1/3, 3/5, 5/7, • • • , every other setting contains redun- 
dant dimensions either in M or A^. Evidently these redundant dimensions contribute superfluous 
variables which inflate the variable count, thereby qualifying a system as proper even when it is not 
feasible. We suspect that this observation may have significant implications in algebraic geometry 
where the solvability of systems of polynomial equations remains an unsolved problem. 

5.5 Degrees of Freedom without Spatial Normalization 

From our results it is clear that for all (M, A^) settings where DoF* takes an integer value, we 
have a precise characterization of DoF (without the need for spatial normalizations). Precise DoF 
characterizations are also available for {M, N) settings where 7 = 77" = for some p G Z+ , 
because in all these settings the outer bound of coincides with the achievability result of Ghasemi 
et al. [lOj , and the DoF value is ]^q^- For the remaining cases, we propose a linear beamforming 
construction for achieving the DoF outer bound without relying on spatial extensions. Because the 
DoF outer bound is a fractional value, symbol extensions over time/frequency are needed to make 
the DoF value a whole number over the extended channel. Interestingly, the construction is always 
non-asymptotic, as in, the number of symbol extensions needed is only enough to make the DoF 
value an integer. We show analytically that while in many cases symbol extensions in time over 
constant channels are sufficient to achieve the information theoretic DoF outer bound, there are 
also cases where time- variations/frequency-selectivity of the channel is needed to achieve the DoF 
outer bound with linear interference alignment schemes. The feasibility of interference alignment 
can be settled in every case through a simple numerical test. We carry out this test to establish 
the DoF values for all (M, N) values upto M, N < 10. In general, we end with the conjecture that 
in all cases, the DoF outer bound value is tight, even with constant channels, and may be achieved 
with non-linear interference alignment schemes, e.g., exploiting the rational dimensions framework 
or the Renyi information dimensions framework. 




Figure 7: Invertible Linear Transformations for the 2x3 Case, (a) Step 1, (b) Step 2 



6 DoF Outer Bounds: Preliminaries 

Recall from the discussion on redundant dimensions, that the settings corresponding to M/N = 
1/2, 2/3, 3/4, 4/5, •• • , are the ones that contain the most redundant dimensions, i.e., for these 
settings, and only for these settings, it is possible to reduce either M or N without losing DoF. It 
follows then, that in order to prove the strongest DoF outer bounds, it is these settings that must be 
considered. Indeed, as we will see in the information-theoretic derivations of the DoF outer bounds, 
essentially the outer bounds must be shown for cases corresponding to M/N = 1/2, 2/3, 3/4, • • • , 
and then with only a little additional effort, these outer bounds can be extended to all M, N values. 

A key step for the information-theoretic DoF outer bound proof is to first perform a change 
of basis operation, corresponding to invertible linear transformations at both the transmitters and 
receivers. While invertible linear transformations at the transmitters and/or receivers do not affect 
the DoF, the change of basis identifies the subspace alignments which in turn helps identify the 
side information to be provided by a genie for the DoF outer bound. Next, we will present the 
invertible linear transformations for the case of (MtjMr) = {p,p+ 1). Since the change of basis 
operations are linear transformations, they are also directly applicable to the reciprocal channel 
according to the dual nature of reciprocal channels [23j . 



6.1 Change of Basis for (My, Mj?) = (2, 3) 

We begin with the simplest case, i.e., the 2x3 MIMO interference channel. The linear transfor- 
mations are carried out by multiplying an invertible square matrix at each transmitter and each 
receiver. The procedure of designing these transformation matrices is illustrated as follows. For 
brevity, we use to denote the 2x2 invertible square matrix at Transmitter k, and to denote 
the 3x3 transformation matrix at Receiver k. 

Step 1: Consider the 3x3 square matrix which has three rows. First, we determine its first 
row and the last row, corresponding to the first and the third antennas at Receiver k. The linear 
transformation is designed in such a manner that the first antenna of Receiver k does not hear 
Transmitter k + 1 and the third antenna of Receiver k does not hear Transmitter k — 1. This is 
illustrated in FigjTjl^a). This operation is guaranteed by the fact that H^(^,_|_]^) and H^^^.j^) are both 
3x2 matrices, and the left null space of each of them has one dimension. Therefore, the first row 



of Rfc lies in the left null space of H^jj-^.,.]^'), and the last row lies in the left null space of 'H.j^(^f^_iy 
That is, 



Rfc(l,:)Hfc(fc+i) = (10) 
Rfc(3,:)Hfc(fc_i) = 0. (11) 

If we choose the first entry of Rfc(l, :) and the last entry of Ra;(3, :) to be one, then their remaining 
entries can be solved through following equations. 

Rfc(l,2:3) = -(Hfe(fe+i)(2:3,:))-'Hfc(fc+i)(l,:) (12) 
Rfc(3,l:2) = - (Hjt(fc_i)(l : 2, :)) ^ Hfc(fc_i)(3, :). (13) 

Step 2: After the first and the third rows of Rfc are specified, we switch to the transmitter side 
and determine the two columns of T^, which correspond to the two antennas at Transmitter k. 
Our goal is to ensure that the first antenna of Transmitter k is not heard by the last antenna of 
Receiver k — 1 but is heard by first antenna of Receiver A; + 1, while the last antenna of Transmitter 
k is not heard by first antenna of Receiver A; + 1 but is heard by the last antenna of Receiver k — 1. 
This is illustrated in Fig. [Tjj^b). As a result, the first column of is chosen in the null space of 
the channel associated with the last antenna of Receiver k — 1 (because the channels are generic, 
this is not in the null space of the first antenna of Receiver A; + 1). Similarly, the last column of 
Tfc is chosen in the null space of the channel associated with the first antenna of Receiver A; + 1. 
Mathematically, 

Rfe_i(3,:)H(fe_i)feT,,(:,l) = (14) 
Rfc+i(l,:)H(fe+i)fcTfc(:,2) = 0. (15) 

Since Rfc_i(3, '■)il(k-i)k and Rfc+i(l, ■)il[k+i)k are 1x2 vectors, the null space of each of them has 
one dimension. Because the channel coefficients are generic, they are linearly independent almost 
surely. Therefore, if we choose the first entry of Tfc(:, 1) and last entry of Tfc(:, 2) to be one, then 
their remaining entries can be solved from following equations: 

Tfe(2, 1) = -Rfc-i(:, l)H(fc_i)fc/Rfc_i(:, 2)H(fc_i)fc (16) 
Tfc(l,2) = -Rfc+i(:, 2)H(fc_,_i)fc/RA,.+i(:, l)H(^,_^i)fc. (17) 

After this operation, the matrix is uniquely determined. 

Step 3: Now let us switch back to the receiver side again, to determine the remaining row (the 
second row) of the Rfc at Receiver k. In order for the transformation to be invertible, we need to 
choose this row such that it is linearly independent with the other rows. For simplicity, we set the 
first and last entries to be zero and the second to be on^ Therefore, the linear transformation 
matrices at both transmitter and receiver sides have been determined. Note that the invertibility 
of these transformations is guaranteed by the generic nature of channel coefficients. 

The resulting network connectivity after the change of basis operations is shown in Fig. [8j 
Since the channel coefficients of the original network are generic, the coefficients of the connected 
links in Fig. |8]are non-zero almost surely. For brevity, we use "a, c" at the transmitters and "a, 6, c" 
at the receivers to denote the corresponding antennas. 

^Note that the manner we choose the second row of is not unique. In Section [s] we will consider another way 
to design this row for a simpler patten of channel connectivity of the resulting network. 




Figure 8: Three-User 2x3 MIMO Interference Channel after the Change of Basis Operation 



Next, we show that these Hnear transformation matrices have fuh rank almost surely and 
hereby invertible. To do that, we need to prove the determinant of each linear transformation 



matrix is non-zero almost surely. Notice that from (12), (13), (16) and (17), except some entries 



are chosen as specific values, all the remaining entries of the transformation matrices are in the 
form of the ratio of two polynomials of the channel coefficients. Therefore, the determinant of 
the linear transformation matrix can be also expressed as a ratio of two polynomials of channel 
coefficients. Further, multiplication with the denominator changes it to a polynomial. To prove 
that the determinant is non-zero almost surely, it suffices to show that the polynomial is not the 
zero polynomial. This can be easily verified through constructing specific channel coefficients for 
this resulting channel. Such a specific construction is as follows. 



H 



{k-l)k 





1 
1 



H 



(fc+i)fc 



1 
1 




(18) 



It is easily seen that the linear transformation for such channel is the identity matrix whose de- 
terminant is non-zero. Therefore, the polynomial is not zero polynomial and thus it is non-zero 
almost surely across all realizations of the channels. 

In the new network obtained after the change of basis, each receiver, after decoding its own 
message and then reconstructing its signal vector sent from its own transmitter, can subtract it 
from its received signal vector, leaving only the interference from the other undesired transmitters. 
In Fig. [sj we use S(^.-^ to denote the noisy interference terms at the receiver antenna (•), thus 
obtaining the interference signal vector Sk = [Ska Skb Skc]'^ where subscripts are associated with 
corresponding receive antennas. The transmit symbols contained within each remaining interference 
term are indicated explicitly, reflecting the connectivity of the network after the change of basis 
operation. 



6.2 Change of Basis for (My, Mr) = (3, 4) 

Consider the linear transformation for the 3x4 setting as another example. We label antennas from 
the top to the bottom of Transmitter k as kai,kbi,kci, respectively. The corresponding columns 
in the transformation matrix are labeled in the same manner. Also, we label the antennas from 
the top to the bottom of Receiver k as kai, ka^, kcQ, kci, respectively, and the corresponding rows 
of the transformation matrix are labeled in the same manner as well. 



Step 1: We start with the hnear transformations at the receiver. First, we ensure that kai does 
not hear Transmitter k + \ and antenna kci does not hear Transmitter k — \. This operation is 
guaranteed because we can choose the columns kai and kci in the left null space of the channel 
matrix ^k{k+i) ^-nd ^k{k-i)j respectively. Since channel matrices are 4x3, these two columns are 
uniquely determined as the corresponding one dimensional left null spaces. 

Step 2: After determining rows kai and kci of Rjt, we can design columns kai and kci of 
at Transmitter k. The goal is to ensure antenna kai of Transmitter k is not heard by antenna 
{k — l)ci of Receiver k — 1. Similarly, antenna kci of Transmitter k is not heard by antenna 
{k + l)ai of Receiver k + 1. Note that in the three-dimensional signal space at Transmitter /c, there 
is a two-dimensional subspace orthogonal to antenna {k — l)ci and another two-dimensional sub- 
space orthogonal to antenna (A; + l)ai. These two two-dimensional subspaces have one-dimensional 
intersection within the three-dimensional space seen from the transmitter. Therefore, we choose 
columns kai and kci as the directions within their corresponding two-dimensional subspaces but 
not in the one-dimensional intersection subspace. Moreover, we will restrict remaining columns at 
Transmitter k to lie in the one-dimensional intersection. In other words, the remaining antennas 
of Transmitter k can see neither the antenna {k + l)ai nor {k — l)ci. In this case, since only 
one antenna kbi remains, the column kbi is fixed as the one-dimensional intersection of those two 
2-dimensional subspaces. 

Step 3: Now we can switch to receivers again to determine rows kao and kco of Rfc. First, 
in order for rows ka^ and kcQ to be linearly independent with rows kai and kci and hereby the 
transformations can be invertible, the subspace spanned by rows ka^ and feco should have only null 
intersection with that spanned by rows kai and kci. For simplicity, we set the first and last columns 
of these two rows to zero. Then our goal is to ensure that ka^ at the receiver does not hear (A; + l)6i, 
and kci at the receiver does not hear [k — This can be easily achieved by choosing the rows 
of kai and feci to be orthogonal to the channel vectors associated with the antenna (fe + and 
(fe — respectively. 

Similar to the 2x3 setting, the invertibility of channel transformation matrices is guaranteed 
almost surely owing to the generic property of channel coefficients. The resulting channel connec- 
tivity after the change of basis operations, as well as the interference as the function of transmit 
signals are shown in FigjO} 
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Figure 9: Three-User 3x4 MIMO Interference Channel after the Change of Basis Operation 



6.3 Change of Basis for (My, Mr) = (4, 5) 



The third example is the 4x5 MIMO interference channel. As we will see shortly, this case has a 
recursive relation with the 2x3 setting. As before, we label the antennas of Transmitter k from 
the top to the bottom as ka2,kai,kci,kc2 and the antennas at Receiver k from top to bottom 
as ka2 , kai , kbi , kci , kc2 ■ The corresponding columns and rows at transmitters and receivers are 
labeled in the same manner. 

Step 1: As before, we start from the first and last antennas at the receiver side. In the 
transformed basis, the first antenna at Receiver fc, fca2, is placed into the null space of Transmitter 
k + 1 such that it does not hear Transmitter /c + 1. The last antenna at Receiver /c, kc2, is in the 
null space of Transmitter k — 1 such that it does not hear Transmitter k — 1. 

Step 2: After the first and last rows of the transformation matrix at each receiver are designed, 
we now turn to the first and last columns of the transformation matrix at each transmitter. The 
goal is to ensure that antenna ka2 and kc2 at Transmitter k cannot see receiver antenna (/c — l)c2 and 
(fc + l)a2. Since there are 4 antennas at each transmitter, there are two 3-dimensional subspaces 
orthogonal to (A; — l)c2 and [k + l)a2, respectively. However, these two subspaces have a 2- 
dimensional intersecting subspace. To achieve the goal, we choose the rows ka2 and kc2 as the 
directions which are linearly independent. Moreover, we will restrict the space spanned by remaining 
two columns {ka\ and kc\) to be the 2-dimensional intersection subspace. As a result, antennas 
ka\ and kc\ will not be heard by either (k + l)a2 or [k — l)c2. 

After Step 1 and Step 2, we have specified the first and last columns and rows of the linear 
transformation matrices at each transmitter and receiver, respectively. To determine the remaining 
three rows of transformation matrices at each receiver, we first need to ensure that they are linearly 
independent with the first and last rows. One way to achieve this is to set the first and last columns 
of these three rows to zero. Therefore, although the receiver has five antennas, the remaining three 
antennas are restricted to access only three dimensional subspaces within this five-dimensional 
signal space. Now ignoring the first and last antennas, the receiver is equivalent to a receiver with 
3 antennas. On the other hand, since the remaining two antennas at each transmitter are restricted 
to access only a two-dimensional subspace in the four-dimensional transmitted signal space, it is 
equivalent to a transmitter with 2 antennas. Therefore, we obtain a core of 2 x 3 interference 
channel, and thus the linear transformations designed for the 2x3 case previously can be applied 
here to determine the remaining columns and rows at each transmitter and receiver. 

Again, it is easy to show that the linear transformation matrices at each user have full rank 
almost surely due to the generic property of the channel coefficients. The channel connectivity after 
the change of basis operations and the interference as the function of transmit signals plus noise 



are shown in Fig 10 



6.4 Change of Basis for (Mt, Mr) = {p,p+ 1) 

After showing three specific examples, we present the change of basis for the general p x (p + 1) 
setting in this subsection. As in the 4x5 setting, the linear transformations for the general setting 
can be determined in a recursive manner. Specifically, for the p x (p + 1) setting, we first design 
the first and last columns and rows for the linear transformation matrices at each transmitter 
and receiver, respectively. Once designed, there remain (p — 2) and {p — 1) columns and rows 
in the transformation matrices to be designed at each transmitter and each receiver, respectively. 
Essentially, this is the {p — 2) x (p — 1) setting if we ignore the two antennas in the outer shell, 
and hereby the design for the {p — 2) x {p — 1) case can be applied. As a result, we only need 
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Figure 10: Three-User 4x5 MIMO Interference Channel after the Change of Basis Operation 
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Figure 11: Invertible Linear Transformations for the 2L x (2L + 1) setting, (a) Step 1, (b) Step 2 



to specify the design of the first and the last columns and rows of transformation matrices at the 
transmitter and receiver sides, respectively, for the general p x (p + 1) case. Since the p x (p + 1) 
case can be reduced to the {p — 2) x {p — 1) case, we further need to consider two subcases. One 
is the (2L, 2L + 1) setting which can be recursively boiled down to the 2x3 case discussed earlier, 
while the other is (2L + 1, 2L + 2) and can be recursively boiled down to the 3x4 case discussed 
earlier, VL G Z^. The algorithm for these two groups are essentially identical. In the following, we 
first consider the (2L, 2L + 1) setting. 



6.4.1 Change of Basis for (M, N) = {2L, 2L + 1) 

We label the antennas from the top to the bottom, as kai, kai-i, • • • , kai, kci, • • • , kci at Trans- 
mitter k, and as kai, kai-i, • • • , kai, kbi, kci, • • • , kci at Receiver k. Each antenna corresponds to 
one column at each transmitter and one row at each receiver, respectively. Therefore, the column 
labeling is from the left to the right of the transformation matrices at each transmitter, and the 



row labeling is from the top to the bottom of that at each receiver. We will always first design the 
first and last rows of the transformation matrix at each receiver, and then based on that design 
determine the first and last columns of the transformation matrix at each transmitter. 

Step 1: Consider Receiver k. The goal is to ensure that the first antenna kai and the last 
antenna kc^ do not hear transmitters k — 1 and A; + 1, respectively, as illustrated in Fig. [ITj^a). 
This can be done by choosing row kai in the left null space of Hfc(fc_x) and row kcL in the left null 
space of Hj!j(fc^i-). Since these two matrices are (2L + 1) x 2L, the left null space has one dimension 
and thus two rows are uniquely determined. After that, the remaining 2L — 1 rows are restricted 
to span the (2L — l)-dimensional subspace that does not overlap with the subspace spanned by the 
first and last rows such that they are linearly independent. One way to achieve this is to set the 
first and last columns, i.e., columns ka^ and kci, of all the remaining rows to be zero. 

Step 2: Once the rows /ca^ and kci, of are determined, we switch to determine the first and 
last columns of the transformation matrix T^. As illustrated in Fig jlgb), the goal is to ensure 
that the antenna kai, of Transmitter k cannot see antenna {k — V)ci, of Receiver A: — 1, while the 
antenna kci, cannot see the antenna {k + l)a„ of Receiver /c + 1. Since there are 2L antennas 
at each transmitter, there are two (2L — l)-dimensional subspaces orthogonal to {k — 1)cl and 
{k + l)ai, respectively. However, these two subspaces have an intersection of 2L — 2 dimensions 
at the transmitter in general, implying that there is only one dimension in each subspace that 
does not overlap with the other. Therefore, we choose rows kai^ and fcc^ in that one dimension in 
each subspace. Moreover, we restrict the space spanned by remaining 2L — 2 columns to be the 
(2L — 2)-dimensional intersection subspace. As a result, antennas kai-i, • • • , kai, kci, • • • , kcL-i 
will not see either {k + l)aL or {k — 1)cl, as shown in Figure [TT|b) . 

After Step 1 and Step 2, we essentially still need to design the (2L — 2) x (2L — 1) setting. We 
can repeat these two steps until we reach the 2x3 core for which the linear transformations have 
been illustrated before. Also, it is not difficult to see these linear transformations are invertible, 
i.e., Tfc and have full rank, almost surely. 



6.4.2 Change of Basis for (M, N) = {2L + 1, 2L + 2) 

The linear transformation for (2L + 1) x (2L + 2) is essentially the same as the case 2L x (2L + 1). 
By designing the first and last rows of the transformation matrix at each receiver first and then 
designing the first and last columns at each transmitter in the same manner as the 2L x (2L + 1) 
case, we end up with the (2L — 1) x 2L case. Repeating such a procedure until we arrive at the 
3x4 setting for which the linear transformations have been illustrated. Moreover, it is not difficult 
to see these linear transformations are invertible as well. 

Remark: Note that this transformation process looks like layer-by-layer onion peeling, as shown 



in Figure 12 Specifically, for the p x {p + 1) setting, by peeling out the outer shell at each user, 
i.e., the first and the last antennas, the remaining part is a (p — 2) x (p — 1) interference channel. 
Repeating this procedure, we eventually obtain the core of the 2x3 interference network if p is 
even as shown in Figure [l2[a), or the core of the 3x4 interference network if p is odd as in Figure 



12 b). The onion peeling intuition is important for the change of basis, as well as help us identify 
the genie signals provided to each receiver for deriving the information theoretic DoF outer bounds 
in Section [71 




Figure 12: Intuition of Onion Peeling, (a) M is even, (b) M is odd 

7 Information Theoretic DoF Outer Bound 

In this section, we will derive the information theoretic DoF outer bound claimed in Lemma [l} 
We organize this section as follows. We begin with the case when M/N < 3/5 where cooperation 
outer bound is sufficient. For the remaining M/N < 3/5 case, we first consider the Mt < Mpt 
setting, i.e., networks that have more antennas at the receiver nodes than at the transmitters. We 
only show some specific examples to convey the central idea to derive the information theoretic 
DoF outer bounds, and defer the general proof to Appendix [X| Since the duality property does not 
hold for the information theoretic statements, we also consider the Mt > Mn setting. Since the 
essential idea still follows the onion peeling intuition, we defer all the rigorous proof to Appendix 
|B} We start with the M/N < 3/5 setting as follows. 

DoF Outer Bound for M/N < 3/5: Consider Figure [2] where the squares are shaded with 
light yellow, green and grey colors: 

(A) M/N e (0,1/3] ^d<M 

(B) M/N G (1/3, 1/2] ^d<N/3 

(C) M/N G (1/2,3/5] ^d< 2M/3 

While we have shown in Section |5.1| that the single user or cooperation DoF outer bounds are 
sufficient for case (A) and (B), we still need to consider the case (C). Fortunately, it turns 
out that for this case, the cooperation DoF bound is still sufficient. Specifically, the result- 
ing two user interference channel by allowing any two of three users to cooperate where User 
1 has Mt and Mr antennas and User 2 has 2Mt and 2i\/R antennas has been proved to have 
min(3MT,3MR,max(MT,2M/j),max(2Mr,M/j)) DoF which is equal to 2min(MT,MR) = 
2M. Since cooperation among antennas cannot reduce the channel capacity, 2M/3 is the DoF per 
user bound for the original channel in case (C). 

DoF Outer Bound for M/N > 3/5: While applying cooperation outer bounds for M/N < 
3/5 is sufficient to establish the sum DoF results (the achievability will be shown in Section [s]), the 
DoF remain open for M/N > 3/5 cases. 



The nature of the DoF outer bound derivation is recursive. To set up the recursion we will first 
solve the core cases and then construct a recursive argument for the general proof built upon the 
reduction to these core cases. The complexity of the problem is such that some partitioning into 
disjoint groups, each of which must be studied separately, is necessary. First, because no claim to 
duality can be made a-priori for information theoretic DoF results, we need to deal with the cases 
Mt > Mr and Mr > Mt separately. Indeed the outer bound proof for the two settings require 
different approaches. Second, within each of these cases, e.g., with Mr > Mt there are also two 
groups of channels, (2L, 2L + 1) and {2L + 1,2L + 2), each of which must be considered separately 
through its own recursive reduction. As such we will need to establish the core results for each of 
these groups, which will make the overall proof of Lemma [T] quite lengthy, rather unavoidably so. 

In the following, we will first show the information theoretic DoF outer bounds for three specific 
examples of {M,N) = {p,p + 1) where p = 2,3,4. Then based on the observation on the proofs 
for these examples, we generalize the information theoretic DoF outer bound proof to (M, A^) = 
{pq, (p + l)q) where p G > 4 and q G Z+ in Appendix [Xj Since results for q > 1 follow from 

q = 1 due to a simple spatial expansion, we only need to consider q = 1, i.e., (M, A^) = {p,p + 1). 
Before we show the specific examples, we first introduce the following lemma that will be often 
used in the converse argument in the remaining of this section. 

Lemma 3 If a genie provides a subset of signals, denoted as Q , to Receiver k, such that it can 
decode all three messages from the observation {Y^,Q), then we can always outer bound the mutual 
information term I{Wi, W2, W3; Y^, Q) as follows: 

I{WuW2,Ws;n\g) = I{Wi,W2,Ws;n^) + I{Wi,W2,Ws;g\Yk^) (19) 

< MRnlogp + I{WuW2,W3;g\Y^) + no{logp) (20) 

< MRnlogp + h{g\Y,^)-h{g\Wi,W2,W3,Y,^) + no{logp) (21) 
= MRnlogp + h{g\Y^) + n o{logp) + o{n). (22) 



Proof: In the derivations above, (19) follows from the mutual information chain rule. (20) is 



obtained because Receiver k has only Mr antennas. (21) follows from the entropy chain rule, and 



(22) is obtained since given all the three messages we can reconstruct the genie signals g subject 



to the noise distortion. ■ 
7.1 Case: {M,N) = (2,3) DoF < | 

After the change of basis operation introduced in SectionlHl we obtain the network with connectivity 



in Fig. [8j shown again in Fig. 13 for the reader's convenience. 

First, a genie provides the signal ^1 = {^2a + ^2a} Receiver 1, where ~ CM{0, 1) is an 
artificial i.i.d. Gaussian noise. Let us consider Receiver 1. Since we are dealing with a converse 
argument, it follows by assumption that the receiver is able to decode and subtract out its desired 
signal. It therefore has 5'"^(-'^2c) = ^2c + ^2c antenna "Ic". Thus, with the provided genie 

signal. Receiver 1 can decode W2 from the observation (Xg^ + ^2^, 5'"c(^2c)) subject to the noise 
distortiorj^ After decoding W2 we can reconstruct the transmitted signals (A'2^,X2c) and subtract 
them from to obtain S'^ which is a linear combination of transmitted signals {X^^,X^^) plus 



*We will often use the phrase "subject to noise distortion" in the remaining of this paper to indicate the widely 
used (see e.g., [Ill [3]) DoF outer bound argument whereby reducing noise at a node by an amount that is SNR 
independent (and therefore inconsequential for DoF) allows it to decode a message. 
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Figure 13: Three-User 2x3 MIMO Interference Channel 

the noise. Now by the two hnearly independent observations of iS^^{X^^), S'^{X^^, ^sc)); Receiver 
1 can resolve {X^^,X^J and thus can decode W3 as well, subject to the noise distortion. Since the 
genie information Qi provided to Receiver 1 allows it to decode all three messages subject to noise 
distortion, we have: 



niRi + R2 + R3) < I{Wi,W2, W3; Yi", ^i) + n o(logp) + o(n) 

< Nnlogp + h{X^, + Z2"jYi") + n o(log/>) + o(n) 

< Nn log p + + Z^JX^^ + Z^J + n o(log p) + o(n) 

< Nn log p + nR2- h{Xl^^ + Z^^) + n o(log p) + o(n) 



(23) 
(24) 
(25) 
(26) 



where (23) follows from Fano's inequality. (24) follows from Lemma [sj (25) follows from the fact 
that dropping the condition terms cannot decrease the differential entropy. Thus, we only keep 
as the condition term which is + .^2c- (^6) is obtained because from the observations of 



i-^2a + ^2a^-^2c + ^2c) decode W2 subject to the noise distortion. By advancing the user 

indices, we therefore obtain the following three inequalities: 



< Nn log p + ni?2 - K^2c + ^20) + n o(log p) + o{n) 
nR^ < Nn log p + nR^ - h{Xg + Z^J + n o(log p) + o{n) 
nR^ < Nnlogp + nRi - h^X"^^ + + n o(logp) + o(n). 



(27a) 
(27b) 
(27c) 



Since we always use "advance the user indices" in a circularly symmetric way, from now on we will 
use compact notations 

R = i?s/3 

/l(X(.)) = [/i(Xi(.))+/i(X2(.)) + /l(X3(.))]/3 



where quantities without user index represent the average of all rotated indices. Thus (27) can be 
rewritten as 



3ni? < Nn log p + nfl - /i(X^ + Z^") + n o(log p) + o{n) . (28) 

Next, let a genie provide the signal Q2 = {X"^^ + Zg^} to Receiver 1 where ~ C7\A(0, 1) 
is an artificial i.i.d. Gaussian noise. Similarly, by providing Q2 to Receiver 1, it can first decode 
subject to the noise distortion from the observation (^"^(Xg^), + Zg^). After decoding 



Ws, Receiver 1 can reconstruct transmitted signals {X^^,X^^^) and then subtract them from S^^ 
to obtain a noisy hnear combination of {X2a, ^2^), from which together with ^"^("'^Ic) Receiver 1 
can decode W2 as weh subject to the noise distortion. Since Receiver 1 again can decode ah three 
messages, we have: 

ni?s < I{Wi ,W2,W^; Yi", + Z^,) + n o(log p) + o{n) (29) 

< Nn log p + h{Xr^^ + ZJJ Yi") + n o(Iog p) + o(n) (30) 

< Nn log p + h{X^^ + Z^J + n o(log /o) + o(n) . (31) 

The derivation above is similar to that for the previous bound. By advancing the user indices, we 
obtain the second inequality as follows. 

3nR < Nnlogp + h{X^ + Z^) + n o(logp) + o(n). (32) 



Adding up the two inequalities of ( |28| and (32), each obtained by averaging over user indices, 
subject to the noise distortion we have: 

6nR < 2Nn log p + nR + n o(log p) + o{n) . (33) 



where h{XJ} + Z") — h{X2 + Z") = n o(log p) + o(n). By arranging terms of (33) we have: 



5nR < 2Nnlog p + n o{log p) + o{n). (34) 



By dividing logp and n on both sides of (34), and letting p — )• 00 and n — )• 00, we obtain: 



. 2iV 6 

«<- = -. (35) 

Note that the genie signals provided to receivers contain Gaussian noise. Since we are interested 
in the DoF characterization and due to the "subject to the noise distortion" statement, we will not 
explicitly mention the noise terms in the genie signal and received signals in the remaining of this 
exposition for simplicity. 



Remark: In order to obtain the inequalities (28) and (32), a genie provides the signal set Qi 



and G2 to Receiver 1, respectively (also to other receivers by advancing user indices). In other 
words, with the genie signal provided to Receiver 1, it can always decode all the three messages. 
Moreover, in the remaining of this paper, unless otherwise specified, it is not difficult to see that 
by providing the genie signal set that will be specified later to Receiver 1, it can always decode all 
three messages subject to the noise distortion. 

7.2 Case: {M,N) = (3,4) DoF < f 

The second example is the (M, N) = (3, 4) setting. After taking the linear transformation intro- 



duced in Section [6j we obtain the network with connectivity shown in Fig 14 and the resulting 
equivalent channel coefficients are non-zero. 

First, a genie provides the signal set Gi = {X2a,X^^} to Receiver 1. As in the {M,N) = (2,3) 
case, it is easy to see by providing this set of genie signals to Receiver 1, it can decode all three 
messages subject to the noise distortion. Consider the sum rate of three messages: 

nRj: < I{WuW2, Ws; ^2", ^3" ) + n o(logp) + o{n) (36) 

< Nn log p + h{X^,, Xg^jYi") + n o(log p) + o(n) (37) 

< Nn log p + /i(X2"J + h{Xl) + n o(log p) + o{n) (38) 
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Figure 14: Three-User 3x4 MIMO Interference Channel 



where (36) follows from Fano's inequality, and (37) is because of Lemma [sj ( |38[ ) follows from the 
chain rule and dropping the condition terms cannot decrease the differential entropy. By averaging 
over the user indices, we obtain the first inequality as follows. 



3nR < Nn\ogp + /i(X^) + h{X^) + n o(logp) + o(n). 



(39) 



Next, a genie provides the signal set Q2 = {^2a-''^2b\ Receiver 1, then the sum rate of three 
messages is bounded above by: 



ni?E < I{Wi, 1^3; ^2a, XJ^b) + n o(log p) + o{n) 

< Nn log p + /i(X2"„, XJ^^\Y^) + n o(log p) + o{n) 

= Nn log p + KX^Y^) + h{X:^,\X^,, Yi") + n o(log p) + o{n) 

< Nnlogp + hiX^jXl) + h{X^,\X^,,Xl) + n o(logp) + o{n) 

< Nn log p + ni?2 - h{X2c) + o(log P) + o{n). 



(40) 
(41) 
(42) 
(43) 
(44) 



The derivation above is similar to that for the previous bound. Note that the last inequality also 
follows that subject to the noise distortion, we can decode the message W2 from the observation of 
(X2jj, ^2^, ^2^). By averaging over the user indices, we obtain the second inequality as follows. 

3ni2 < Nn log p + nR- h{X^) + n o(log p) + o{n). (45) 

Similarly, if a genie provides the signal set ^3 = {X^fj,X^^} to Receiver 1, then we have: 

ni?E < I{Wi, W2, Wr, Yl", Xg, XI) + n o(logp) + o{n) (46) 

< Nn log p + h{Xl, X^,\Y^) + n o(log p) + o{n) (47) 
= Nn\ogp + h{Xl\Y^) + h{Xl\X^,,Y{^) + n o{\ogp) + o{n) (48) 

< iVnlogp + h{X^,\X^,) + h{Xl\Xl,X^,) + n o(logp) + o(n) (49) 

< Nn log p + ni?3 - /i(X£j) + n o(log p) + o(n) . (50) 

where the last inequality follows that subject to the noise distortion we can decode from the 
observation of (Xg^, Xg^,, Xg^). By averaging over the user indices, we obtain the third inequality: 



?,nR < Nn\ogp + nR - h{X^) + n o(logp) + o(n). 



(51) 



Adding up the three inequahties (39), (45) and (51), we have: 



9nR < 3Nn log p + 2nR + n o(log p) + o(n) . 



(52) 



By arranging terms of (52) we have: 

7nR < 3Nn log p + n o(log p) + o{n) . 



By dividing log p and n on both sides of (53), and letting p — )• oo and n — )• oo, we obtain: 



d < 



3N 12 



7 



7 



(53) 



(54) 



DoF < 



20 
9 



7.3 Case: (M, A^) = (4, 5) 

We show the third example is this subsection. Let us consider the {M, N) = (4, 5) setting. Similar 
to the two examples we have shown, we again take linear transformations introduced in Section |6j 



thus obtaining the network with resulting connectivity shown in Fig 15, and the equivalent channel 
coefficients are non-zero. 
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Figure 15: Three-User 4x5 MIMO Interference Channel 

As what we have shown in Section [6] that the linear transformations of the 4x5 setting follow 
from a recursive manner (onion peeling insights), in this subsection, the readers can easily observe 
that the genie signals in this network also have a recursive relationship with those for the (M, A^) = 
(2, 3) setting. We will emphasize this observation in the next subsection. 

First, a genie provides the signal set Gi = {-^^202' "^3c2' "^2ai} Receiver 1. Let us consider the 
sum rate of three messages: 

ni?s < I{Wi ,W2,Ws; , X^,^ , X^,^ , Xl^,^ ) + n o(log p) + o{n) (55) 

< Nn\ogp + h{Xl^,^,Xl^,Xl^,^\Y{')+no{\ogp)+o{n) (56) 

< iVn logp + KXI^JY^^) + h{X^,^\Yl') + h{X^jY,\X^,.^,Xl.J + n o(logp) + o(n) (57) 

< Nn log p + h{X^,^ I X^^ ) + h{Xl^ ) + h{X^,^ \X^,^ , X^^ , X^^ ) + n o(log p) + o(n) (58) 
= iVn log p + h{Xl^) + nR2 - KX^J - hiX^,^\X^,^, X^J + n o(logp) + o(n) (59) 



where (55) follows from Fano's inequality, and (56) is due to Lemma [Sj ( |58[ ) is obtained because 
dropping conditioning terms does not decrease the differential entropy. By averaging over the user 
indices, we therefore obtain the first inequality as follows. 

3nR < Nn log p + h{X'^^ )+nR- h^X^ ) - h{X^^ \X^^ , X^^ ) + n o(log p) + o(n) 

Nn log p + nR- h{X^^ \ X^^ , X^^ ) + n o(log p) + o(n) . (60) 

Second, a genie provides the signal set Q2 = {^2a2^ -^302^ -^Sci} *° Receiver 1. With the similar 
analysis we have the sum rate bound: 

< I{Wi,W2,W3;K,X^,^,Xg^,Xg^)+no{logp) + o{n) (61) 

< Nn log p + h{X5,^ , X^,^ , X^^ m + n o(log p) + o{n) (62) 

< Nnlogp + h{X^J + /i(X3",J + h{Xl^\Y{',X^,^,Xg^) + n o(logp) + o(n) (63) 

< iVn log p + /i(X2",, ) + hiXl^ ) + /^(Xg",^ 1X3",^ , X^^ ) + n o(log p) + o(n) (64) 

where the last inequality is obtained because knowing we can decode Wi, and thus we obtain 
Sf which is a noisy version of X^^ . Then we use the fact that dropping the condition terms 



cannot decrease the differential entropy. By averaging over the user indices, we have the second 
inequality: 



3ni? < Nn log p + h{Xl ) + h{X^^ ) + h{Xl \ , ) + n o(log p) + o{n) . 
Third, a genie provides signals Gs = {-^^202 ' "'^^ai ' "^2ci } *° Receiver 1. Thus, we have: 
nR^ < I{Wi,W2,W3;K,^2a2,X^a,,X^J + no{logp) + o{n) 

< Nn log p + h{Xl^ , ^ , \Y^n + n o(log p) + o(n) 

< Nn log p + /i(X2"„, , ^ , X2",^ 1X2",^ ) + n o(log p) + o(n) 
= iVn log p + ni?2 - HX2C2) + o(logP) + o{n) 

and by averaging over the user indices, we have the third inequality: 

3nR < Nnlog p + nR - h{X^^) + n o(logp) +o(n). 
At last, a genie provides signals ^4 = {Xg^^ , Xg^^ , Xg^^} to Receiver 1, and we have: 
nR^ < I{Wi,W2,W3;Yr,XSa„Xl„Xg,^) + no{logp) + o{n) 

< Nn log p + h{XS,^ , X^,^ , Xg",^ I n") + n o(log p) + o(n) 

< iVn log p + /i(X3"„^ , Xl^ , Xg- jXg", J + n o(log p) + o(n) 
= Nn log p + ni?3 - /i(X£j2 ) + " o(log p) + o(n) 

and we obtain the last inequality after averaging over the user indices: 

3nR < Nn log p + nR- h{X^^ ) + n o(log p) + o(n) . 



Now add up all the sum rate inequalities in ( |60[ ), (65), (70) and (75) we have: 
l2nR < ANn log p + 3nR + n o(log p) + o(n) . 



By arranging terms of (76) we have: 

9ni?2 < ANn log p + n o(log p) + o(n). 
By dividing log p and n on both sides of (77), and letting p — t- 00 and n 

, m 20 



00, we obtain: 



(65) 

(66) 
(67) 
(68) 
(69) 

(70) 

(71) 
(72) 
(73) 
(74) 

(75) 

(76) 

(77) 



7.4 Onion Peeling: The Intuition of the DoF Outer Bound Proof 



While we have only shown the information theoretic DoF outer bounds for (M, N) = 1), p = 

2, 3, 4 settings, it is not difficult to see that they share some similarities in both genie signals and 
sum rate bounding techniques. In this subsection, we will specify these similarities and build the 
intuitions behind the outer bound derivations so as to solve general (M, N) = {p,p + l) cases where 
p S Z. There are two questions that we will answer: 

1. How should we design the genie signal sets with minimum cardinality such that each receiver 
with each genie signal set can decode all three messages? 

2. In order to finalize the converse arguments, how many sum rate bounds do we need totally? 

Answer to Question 1: In the three examples that we have shown, we always provide genie 
signals to Receiver 1 so as to upper bound the sum rate of three users, then we obtain the other two 
sum rate inequalities by advancing user indices and eventually have one inequality by averaging 
over three users for compact notations. That is to say, each receiver needs enough extra signaling 
dimensions provided by the genie to distinguish the signal vectors sent from the other two users as 
well. For an M x interference channel, since each receiver is able to decode its own message, it can 
subtract the signal carrying its desired message and obtains linearly independent combinations of 
the interference signals from the 2M transmit antennas (dimensions) of the two interferers. Thus, in 
order for the receiver to decode the other two undesired messages, a genie needs to provide a signal 
set containing at least max(0, 2M—N) linearly independent dimensional signals to that receiver 
such that it can recover the signal vectors sent from the two interferers directly or by an invertible 
linear transformation subject to the noise distortion. Therefore, as in (M, N) = (2, 3), (3, 4), (4, 5) 
cases, each genie signal set has one, two, three dimensions, respectively. 

After knowing each genie signal set has max(0, 2M—N) dimensions, we still need to specify 
which max(0, 2M—N) dimensions that a genie provides. Let us first recall 2x3 and 4x5 cases. 
Note that we only consider providing genie signals to Receiver 1 because by advancing user indices 
we can circularly symmetrically obtain that for Receiver 2 and 3. For the 2x3 setting, a genie 
provides and Ag^, respectively, one for each time. For the 4x5 setting, if we peel out the two 
antennas in the outer shell, i.e., by providing the corresponding transmitted signals (A^^^, Ag^^) in 
the information theoretic statements, the remaining part is an embedded (M, N) = (2, 3) setting. 
For the 2x3 setting, the two genie signals are Ag^^ and AJ,^ , respectively, and thus for the 4x5 
setting, at least we should have two sets of genie signals, which include ( A^j^ i -''^3c2 ) one of Ag^^ 
and Ag^^ , respectively. After doing this, the remaining task is to bound the sum rate of the signals 
sent from the peeled out layer. For example, in the (M, N) = (4, 5) case, we have four sets of genie 
signals, two more than that in the (M, N) = (2, 3) case. In fact, for the general (M, N) = {p,p + 1) 
case, as in the proofs that we show for general cases, the genie provides a total of p sets of signals 
to Receiver 1. In the p — 2 sets among them, the signals include that designed for the {p — 2,p — 1) 
setting plus the two signals sent from the first antenna of Transmitter 2 and the last antenna sent 
from Transmitter 3. 

Answer to Question 2: The number of sum rate inequalities depends on how many sets of 
signals that genie provides to Receiver 1 (also for Receiver 2 and 3 by advancing user indices). In 
the cases of (M, A) = (2,3) and (3,4), the number of genie signal sets is 2 and 3, respectively, i.e., 
identical to the value of Essentially, one set of genie signals produces one sum rate inequality, 

^The number of genie signal sets provided to each receiver is associated with the length of subspace alignment 
chain k. In the special (M, A*') = {p,p + 1) case where p € Z+, this number is equal to M. 



and thus we have a total of M sum rate inequaHties. Prom the three examples, it can be seen that 
in each inequality, on the right-hand-side, there is an Nn log p term plus extra terms. These extra 
terms, if added through the total of M inequalities, produce the term (M — l)nR subject to the 
noise distortion, i.e., 

^ 3 Af 

3 E E ^(GiLlyk) = {M- l)nR + n o(logp) + o{n) (79) 

k=l m=l 

where | Yl^=i indicates averaging over user indices, and Gj^i^ denotes the m^^ set of genie signals 
provided to Receiver k for the {p, p + I) case. In this paper we also write as Gm '^^ Gm with 
respect to Receiver 1 for simplicity if there is no ambiguity, and G2m,G3m can be obtained by 
advancing user indices of Gm- Therefore, we have the following inequality: 

3MnR < MNn log p + {M - l)nR + n o(log p) + o(n) (80) 

which implies the DoF per user bound 

MN _ MN 
- 2M + 1 ~ M + N' ^ ' 

The arguments we show above based on the onion peeling intuition are summarized in Table 
[l] where Gm denotes the m*'^ genie signals set provided to Receiver 1 for the {M,N) = {p,p + l) 
case. Prom this table, it can be easily seen that for the (M, M + 1) case, the first M — 2 genie 
signal sets, i.e., Gm ^ m = 1, 2, • • • , M — 2, are always equal to Gm~'^j m = 1, 2, • • • , M — 2 plus 
(X^j^ , X^^^ ) . This observation builds the foundation of the recursive proof that will be shown in 
detail in Appendix [A} 

Table 1: Examples of Genie Signal Sets Provided to Receiver 1 for the (M, M + 1) Setting where 
M = 2,3, ••• ,7 (Note that in the previous analysis, for L = 1 cases we omit the layer indices 
associated with the antennas for simplicity.) 



Layers 


L = 1 


L = 2 


L = 3 




M is even 
M = 2L 


G! = {XEaJ 
Gl = {XgJ 


Gt = {GlX^^^,XS^J 
Gl = {GlXS^^,XSJ 

ot 


Ol = {GlXi^a,.X^,,} 
Ol = {GtX^,^,X^^^] 

e| = {^3^^2a3>^3c3} 

Gi = {Gi,X'^ X^ } 

Ql 
Gl 




M is odd 
M = 2L + 1 


G! = {X^a,,X^^J 
Gl = {X^a,,X^,^} 

Gl = {X^b,,XgJ 


G! = {Glx^^^,x^^j 

Gl = {GlXS^^,XSJ 
Gl = {GlXS,^,XSJ 
Gl 
01 


Gl = {GlXl^^,,X^,,} 
Gl = {GlXli,^,X^^^] 
Ol = {OlXl^^,Xl^^] 
Gi = {Gi,X2^^,X'^^^] 

Ol = {^5'^2a3'^3c3} 

01 
0] 





Por general (M, A^) = (p,p + 1) where p > 4 as well as M/N ^ p/{p + 1) cases, since the proofs 
are much more cumbersome but still follow from the intuition shown above, we defer all of them 
to Appendix [A} 

Por the setting Mt > Mji, the proofs also follow from the onion peeling intuition introduced in 
Section [6j and we defer them to Appendix [B] 



8 DoF Achievability 



The achievable schemes are based on hnear beamforming at the transmitters and zero forcing at the 
receivers. Due to the reciprocity of the hnear scheme, without loss of generality, we only provide 
achievable schemes for the case when Mt < Mr, so that Mt = M and Mr = N. 

As we explained in Section 5.1, when M/N < 1/2, interference alignment is not needed and 
zero-forcing at receivers is sufficient to achieve the optimal DoF. When M/N > 1/2, interference is 
needed. In this regime, as mentioned in Section 5.3.1 , only for M/N £ B = {1/3, 3/5, 5/7, 7/9, • • • }, 
neither M nor N contains any redundant dimensions. For all other cases, either M or N can be 
reduced without losing DoF. Therefore, we can reduce M or N depending on their ratio such 
that the ratio becomes one of the ratios in B to achieve the same DoF for the original M and N. 
As a consequence, we only need to provide achievable schemes for the case when M/N G B and 
M/N > 1/2. The achievable schemes for all other cases follow directly from these schemes. 



8.1 Case: M/N > 1 /2 and M/N = {2p - 1) /{2p + 1) 

The cases M/N > 1/2 and M/N G B correspond to the settings where each transmitter has 
(2p — l)q antennas and each receiver has {2p + l)q antennas, Vp, g € Z"*",/? > 2. We will show 
that each user can achieve pq DoF, for a total of 3pq DoF. Since integer DoF are achieved, symbol 
extensions or spatial extensions are not needed. 



The achievable scheme can be understood intuitively as follows. As explain in Section 5.2 the 



length of the subspace alignment chain is k = = p- Each subspace participated in the chain 

is q dimensional and thus a total of pq DoF are sent for a chain, occupying a total of {2p + l)p 
dimensions at all receivers. Since there are {2p + l)p dimensions at each receiver, a total of three 
subspace alignment chains, each originating from one of three transmitters, can be packed for this 
channel, thus achieving 3pq DoF. Next, we will show how to design these three subspace alignment 
chains. Before we present the general achievable schemes, let us first consider two simple cases, i.e., 
p = 2,3. 



8.1.1 Case: {M,N) = {3q,5q) {p = 2) 

For the 3q x bq case, we will show each user can achieve 2q DoF. Specifically, Transmitter i sends 
2q independent symbols using a 3g x 2g beamforming matrix Vj . First note that the length of the 
alignment chain is 2 in this case, so there are two signal spaces that participate in each alignment 
chain. Due to symmetry, there are also two signal spaces at each transmitter that participate in the 
other two alignment chains, one for each chain. In addition, since there are three alignment chains, 
we will use a superscript to denote the chain index to which the subspaces belong. Specifically, 
we use where k,i G {1,2,3} to denote the s^^ g-dimensional subspace at Transmitter i that 

participates in the k*^ chain, and in this case s = 1. 

Let us start with the first alignment chain which originates from Transmitter 1: 



(82) 



Mathematically, the alignment equation is 



H21V 



21 



1(1) 



H23V 



3(1) 



H 



23j5qx6q 



^l(l) 
^3(1) 



0. 



(83) 
(84) 



Since Ap is a 5q x 6q matrix, ap can be obtained as q basis vectors of the null space of Ap. Prom 
SLp, we can obtain V^-,^^ and V^j^-,^^. 

Then the second alignment chain which originates from Transmitter 2 is 



^2(1) ^ ^ ^l(l)- 



Mathematically, the second alignment equation can be written as 



H32V 



2 

2(1) 



H3iV2 



fH 



32 



H 



31J 



(1) 
^2(1) 
^l(l) 



(85) 

(86) 
(87) 



Again, since Bp is a 5q x 6g, bp is chosen as q basis vectors of the null space of Bp, from which we 
can obtain can obtain V2^-^^ and ^1(^iy 

Finally, the third alignment chain which originates from Transmitter 3 is 

-I 7-'^ Rx 1 



which produces the third alignment equation: 

Hi3V^(^) 

^ [Hi3 — H12 



Hi2V3 



2(1) 

^3(1) 
^2(1) 



(89) 
(90) 



Cp is chosen as q basis vectors of the null space of Cp, from which we can obtain Vg^-,^^ and ^"2^^^^. 

After aligning interference, we ensure that the dimensions occupied by the interference is small 
enough. To decode the desired signals, the desired signal space cannot overlap with the space of 
interference. This is guaranteed by an independent linear transformation of the desired signals 
from the transmitter to its corresponding receiver. Notice that the direct channels are not used to 
align interference and they are generic channel matrices without special structure. Therefore, after 
going through an independent linear transformation, the desired signals do not overlap with the 
interference almost surely. 



8.1.2 Case: {M,N) = {5q,7q) (p = 3) 

Now let us consider the case 5g x 7q, for which every user can achieve 3q DoF. Again, we need to 
design three alignment chains each with length 3, each originating from one of three transmitters. 



The first alignment chain which originates from Transmitter 1 is 



, Rx 2 -I Rx 1 -J ,1 



1(1) ^ " 3(1) 

Mathematicahy, the ahgnment equations are 



H2iVj(^) 

^13^3(1) 



= Ho^V 



23 ' 3(1) 
2(1) 



Hi2Vi 



H21 — H23 
Hi3 





— H12 



- 14qxl5q 



^3(1) 



0. 



(91) 
(92) 



Note that Ap is a lAq x 15q matrix. Therefore, is chosen as the q basis of the null space 
from which we can obtain can obtain Vj^j^-j, V2^-^^, Vg^-j^-j. 

Then, the second alignment chain which originates from Transmitter 2 is 



of Ap, 



^2(1) ^ ^ ^l(l) ^ 



(1) 



^V^(i)- 



Mathematically, we have the alignment equations 



H2iV2(i) 



H32 — H31 
H21 



H23V|(i) 





-H23 



J 14gxl5i} 



^2(1) 
^l(l) 
^3(1) 



(93) 
(94) 



Similarly, bp is chosen as the q basis of the null space of Bp, from which we can obtain can obtain 

V2 y2 ^2 
^2(1)' ^l(l)' ^3(1)- 

Finally, the third alignment chain which originates from Transmitter 3 is 



V3 v3 
^3(1) ^ ^ ^' 



Rx3 ^3 

2(1) ^ ^i{iy 



This subspace alignment chain produces the following alignment equations: 



H32V2 



His 




2(1) - 

— H12 
H32 



H31V 



2(1) 
3 

1(1) 





-H31 



-I 149X15? 



^3(1) 
^2(1) 
^1) 



(95) 
(96) 



Cp is chosen as the q basis of the null space of Cp, from which we can obtain can obtain V: 
V^(i) and V3(^). 



3(1)' 



8.1.3 Case: {M,N) = {{2p-l)q,{2p + l)q) 

Now, consider the general {2p — l)q x {2p + l)q case. Again, we will design three g-dimensional 
subspace alignment chains with length p, each originating from one of three transmitters. Let 
V*^^^^, k,i G {l,2,3},s G {l,---,[p/3]} denote the s^^ (/-dimensional subspace at Transmitter 

i that participates in the k^^ subspace alignment chain. In addition, let p = {p mod 3) and 
p = [p/3]. Next, we can write three subspace alignment chains. 

We start with the first alignment chain which originates from Transmitter 1. Let a(l) = 
1, a(2) = 3, a(0) = 2. Then the first alignment chain is 



1(1) ^ ^^3(1) ' * 2(1) ' " 1(2) ' " 3(2) ' " 2(2) 

Mathematically, we have the following alignment equation: 



1-17-1 R 



3,7-1 R 



2-17-1 R 



> •••V 



Rx a(p + 1) 



a(p-l)(p-l) 



V 



1 



(97) 



(98) 



where 





H21 


— H23 



















Hi3 


— H12 



















H32 


— H31 






































Ha(p+i)a(p-i) 


—^a(p+l)aip) . 



Bp 



^3(1) 



^a{pm 



(99) 



Since Ap is a (p— l)(2p-|- l)g x p{2p— l)q matrix, q columns of Sp are chosen as the q basis vectors 
of the null space of Ap, from which we can obtain V^^^, • • • , Va(p)(p)' 

Similarly, let b{l) = 2,6(2) = 1,6(0) = 3. Then the second alignment chain which originates 
from Transmitter 2 is 



V 



Rx 3 17-2 

i — > V: 



Rx 2 17-2 

i > Vn 



Rx 1 17-2 



Rx 3 17-2 



Rx 2 17- 

i > V: 



2(1) ^ ^ 1(1) ' ^ 3(1) ^ 2(2) ' 1(2) 

Mathematically, we have the second alignment equation: 



3(2) 



V 6(p_i)(p_i) 



Rx b(p + 1) 



where 











Bpbp = 




H32 


— H31 

















H21 


— H23 

















Hi3 


— H12 



















H 



b{p+i)b(p-i) 



H 





b{p+i)b{p) 





r v2 1 

^2(1) 


, bp = 


^l(l) 







(101) 



(102) 



Again, since Bp is a (p — l){2p + l)q x p{2p — l)q matrix, q columns of bp are chosen as the q basis 
vectors of the null space of Bp, from which we can obtain ^2(1)^ " " " ' ^b(p)(p)' 

Finally, let c(l) = 3, c(2) = 2,c(0) = 1. Then the third alignment chain which originates from 
Transmitter 3 is 



V3V) ^ v3 



Rx 3 1 r3 Rx 2 1 ,3 Rx 1 1 ,3 Rx 3 1 ,3 i 7-3 R'^ c( p + 1 ) 

2(1) ^ "^liD ^ V^(2) ^ V^(2) ^ V3(2) . . . Vj^_^)(^) ^ 



Vc(p)(,)-(103) 



Mathematically, this subspace alignment chain implies the following alignment equation: 



CpCp 



(104) 



where 





Hi3 


— Hi2 



















H32 


— H31 











Cp — 








H21 


— H23 






































Hc(p+l)c(p-l) 


~Hc(p+l)c(p) _ 



(105) 



q columns of Cp are chosen as the q basis vectors of the null space of Cp, from which we can obtain 





r v3 1 

^3(1) 




^2(1) 









^3(1)' 



• ^6(p)(p)- 



After the interference is aligned, we ensure the dimension of the space spanned by the inter- 
ference is small enough. To make sure each user can achieve pq DoF, it remains to show 1) the 
space spanned by the desired signal and that spanned by the interference do not overlap, and 2) the 
constructed bcamforming vectors for each user using the proposed alignment scheme are linearly 
independent. For the first one, since the direct channels do not appear in the alignment equations 
and are generic without any special structure, the desired signals and interference do not overlap 
each other almost surely. Next we prove the second one. 

First note that all entries of the beamforming vectors are ratios of polynomial functions of the 
channel coefficients. To prove all the {2p ~ l)q x pq bcamforming matrix Vj at Vj at transmitter 
i is full rank almost surely, it is sufficient to show the determinant of the following square matrix 
is not equal to zero almost surely: 



(106) 



where is a randomly generated {2p — l)q x (p — l)q matrix. Now the determinant of the above 
matrix is a polynomial function of its entries. This polynomial is either a zero polynomial or not 
equal to zero almost surely, since there arc finite number of solutions of the polynomial equation, 
which has measure zero. Therefore, if the polynomial is not a zero polynomial, the polynomial is 
not equal to zero almost surely for randomly generated channel coefficients. Next, we will show 
the polynomial is not a zero polynomial. To do that, we only need to find one specific set of 
channel coefficients such that the polynomial is not equal to zero. For brevity, we next construct 
the channels for the case when q = 1. The construction for arbitrary q follows in a straightforward 
manner. 

Suppose the channel matrix H(j_i)j is 



H 



I(p_l)x(p-1) 


0(p— l)xp 


Olx(p-l) 


Olxp 


Opx(p— 1) 


Ipxp 


Oix(p-i) 


Olxp 



,VzG {1,2,3}. 



(107) 



And the channel matrix H^j^^^j is 



H 



Oix(p-i) 


Olxp 


(p-l)x(p-l) 


0(p— l)xp 


Olx(p-l) 


Olxp 


Opx(p— 1) 


Ipxp 



,ViG {1,2,3}. 



(108) 



It can be verified that the ahgnment schemes proposed before produce the fohowing beamforming 
matrix for each transmitter: 

(109) 

With this full rank beamforming matrix, it can be easily seen that has full rank and its determi- 
nant is not equal to zero almost surely. Therefore, the beamforming vectors of each user designed 
by the alignment schemes before are linear independent almost surely. 



8.2 Achievability for General Cases with only Space Extension 

With the understanding of the achievable schemes for the settings M/N = (2p — l)/{2p + 1) for 
p = 2, 3, • • • , we can consider the achievable schemes for all other cases. Recall that the optimal 
DoF given by Theorem [T] are as follows: 

{ p ]\/T Pz± < M < 
V^' P = 2,3,.... (110) 

2p+l^^' 2p+l — Af — p+1 

We will prove that for a finite integer q such that qd is an integer, the qM x qN interference channel 
achieves qd DoF per user. Therefore, the spatially-normalized DoF are d. 

Let us first consider the case < < 2p+i ■ ^^^^ regime, the DoF only depend on M, 
i.e., d = 2p-i ^- other words, the bottleneck of the DoF in this regime is the value of M. If 
we fix M, that DoF value does not change even if changes as long as the ratio remains in that 
regime. If M is an integer multiple of 2p — 1, we can reduce the number of antennas A'^ such that 
the ratio becomes ^^-.l . And once the ratio is equal to ^ the achievable scheme proposed in last 
subsection can be applied. On the other hand, if M is not an integer multiple of 2p — 1, we scale 
M and by a factor of 2p — 1 to obtain a {2p — 1)M x {2p — 1)N interference channel which is 
a spatially scaled version of the original channel. Again for this channel, we reduce the number of 
antennas at the receiver from {2p — 1)N to {2p+ 1)M such that the ratio of the number of transmit 
and receive antennas is equal to 2p+i ■ ^PP^yi^S the achievable scheme in last subsection, we 
can achieve pM DoF per user. Therefore, the spatially-normalized DoF of 2p-\ ^ P^^ v&gt can be 
achieved for the original M x N interference channel. 

Now consider the other case < ^ < where the optimal DoF per user, 2fy[-^' '^^^y 
depends on A^. Similar to the previous case, if A'^ is an integer multiple of 2p + 1, we can simply 
reduce the number of transmit antennas (i.e., some transmit antennas are redundant), such that 
the ratio becomes 2p+i ■ Therefore, the achievable scheme proposed before can be applied here. If 
A'^ is not an integer 2|? + 1, we can scale M and A^ by a factor of 2p+ 1. By reducing the number of 
transmit antennas for the spatially scaled version of the original channel, we can achieve pN DoF 
per user, thus spatially-normalized 2p+i ^ DoF for the original channel. 

8.3 Achievability with Symbol Extensions in Time/Frequency Domains 

While we have shown the achievability for all cases (with spatial normalization for the cases where 
fractional DoF are optimal), one question that remains unresolved is whether the outer bound 
can be achieved as well if we restrict to only symbol extensions over time/frequency, i.e., without 
spatial normalization. The difficulty is to deal with the added complexity of block diagonal channel 



structure that would result from channel extensions. In other words, the channels are not generic 
with symbol extensions. As a consequence, although the alignment schemes presented before can 
still be applied to align interference, it is not clear that desired signals remain distinguishable from 
interference after going through the direct channel due to the special channel structure. In this 
subsection, we first explore some simple cases and show that the outer bound is still achievable 
for these simple settings with linear schemes using symbol extensions. Then we will construct a 
linear scheme with symbol extensions for general cases. While in many cases symbol extensions in 
time over constant channels are sufficient to achieve the information theoretic DoF outer bound, 
there are also cases where time- variations/frequency-selectivity of the channel is needed with linear 
interference alignment schemes. The feasibility of such schemes can be tested through simple 
numerical tests. Let us start with some settings where symbol extensions in time over constant 
channels are not sufficient to achieve the outer bound, i.e., (M, A^) = {p,p + 1) where p >2. 



8.3.1 Case: (M, N) = {p,p + 1) 



We will first consider the 2x3 setting and analytically prove that over the constant channels, 
the linear scheme introduced in this paper does not apply to this setting. Such analysis can be 
generalized to show that for {M,N) = {p,p + 1) cases where p > 2, linear schemes with symbol 
extensions over constant channels are not sufficient to achieve the DoF outer bound. Then we 
will introduce time- variation/frequency-selectivity to the channel and show that in this case, linear 
schemes with symbol extensions can achieve the DoF outer bound. 





Figure 16: Normalizing the Interference-carrying Links of the 2x3 Setting to Identity Matrices 

Let us start with the 2x3 setting. First let us recall the invertible linear transformation 
introduced in Figure [8] in Section [6j It can be seen that at Receiver k after subtracting the signal 
carrying its desired message, the first antenna only sees X(^j^_i^^ and the third antenna only sees 



X, 



(k+l)a' 



Therefore, Receiver k is able to subtract X 



X(k+i)a from Skb, such that the resulting 



(fc-l)a) ^(fc+l) 



channel connectivity becomes the one shown in Figure [Tm In Figure 16 there are three open chains 



denoted as blue, green and red colors, each implying a subspace alignment chain with length 2. 
Because they are open loop, we can normalize the channel coefficient of each segment to be one. 
As a result, we can write the cross channel matrices as follows. 



H 



kik+l) 





1 
1 



H 



k{k~l) 



1 
1 




:iiii 



For simplicity, we still use H^fe to denote the direct channel matrix of User k after the change of 
basis operations. Now Suppose we can achieve 6/5 DoF per user, which can be done by achieving 
6 DoF per user over 5 time slots. With 5 symbol extensions, the effective channel matrix becomes 

Hji = l5^Hji (112) 

where I5 is the 5x5 identity matrix. To ensure each user can separate 6 desired signal vectors 
from the interference in its 15-dimensional signal space, the dimension of the space spanned by 
12 interference vectors cannot be more than 9. Therefore, at each receiver, we need to align 
3 interference vectors. Note that in the signal space at each receiver, there is a 5-dimensional 
subspace that can be accessed by two intcrfcrcrs. Then we can randomly choose 3-dimensional 
subspace in this common subspace as the subspace where the 3 interference vectors align. Mapping 
these 3-dimensional subspace back to the interferers determines the beamforming matrix at the 
transmitter. Since each transmitter interferes with 2 receivers, each of two unintended receivers 
will determine 3 beamforming vectors, for a total of 6 beamforming vectors. 

With this intuitive understanding, on the symbol extended channel, we write the 10 x 6 beam- 
forming matrix of user i, Yi, as Vj = [Vj^i Vi,2] where Vi,i and Vi,2 are 10 x 3 matrices. Then at 
Receiver 1, we align the first 3 beams from Transmitter 2 with those from Transmitter 3. Mathe- 
matically, we have 



13 V 3,1 



H 



13 



H 



Hi2V2,l 

V3,l 



12 



L V2,i 







(113) 

(114) 



Since A is a 15 x 20 matrix, a can be obtained as 3 linearly independent vectors in the 5-dimensional 
null space of A. Notice that the five basis vectors of the null space of A are columns of the matrix 
I5 <8) Vi where Vi is the unique vector in the null space of the 3x4 matrix [H13 — H12], i.e.. 



m 



13 



Hi2]Vi = 



where 



m 



13 



H 



12 



1 







-1 









-1 



Therefore, the direction of Vi is uniquely determined and can be written as: 

Vi = [0 1 1 0]^. 
Then, we obtain three columns of a as 

a = (I5 (8) Vi)a 



(115) 



(116) 



(117) 



(118) 



where a = (ajj) is a 5 x 3 combining matrix with i.i.d. randomly generated entries. 

Similarly, at Receiver 2, we align the first 3 beams from Transmitter 1 with the last 3 beams 
from Transmitter 3. Mathematically, 



H2lVi,i = H23V3^2 



[H21 — H23] 



V 



1,1 



L ^3,2 







(119) 
(120) 



Then we can choose b as 



b = (I5 ® V2)b 



(121) 



where V2 is the unique vector in the null space of the 3x4 matrix [H21 — H23], i.e., V2 = Vi, 
and b = (bij) is a 5 x 3 matrix with i.i.d. randomly generated entries. 

At Receiver 3, we align the last 3 beams from Transmitter 1 with those from Transmitter 2, 
hereby we have the equation: 



H32 V2,2 — H31 V 



[H32 — H31] 



31 V 1,2 
" V2,2 
. Vl,2 







(122) 
(123) 



Then we can choose c as 



C = (I5 (g) V3)C 



(124) 



where V3 is the unique vector in the null space of the 3x4 matrix [H32 — H31], i.e., V3 = Vi, 
and c is a 5 X 3 matrix with i.i.d. randomly generated entries. 

After aligning interference, we ensure that the dimension of the space spanned by interference 
is small enough. In order for each receiver to decode the desired message, it remains to see if the 
desired signals and interference do not overlap at each receiver. Specifically, we need to see if the 
15 X 15 matrix consisting of 6 desired signal vectors and 9 effective interference vectors has full 
rank. Due to the symmetry of the signaling, let us consider Receiver 1. The 15 x 15 matrix at 
Receiver 1 is given by: 



G — [HiiVi^i HiiVi,2 Hi2V2,l Hi2V2,2 Hi3V3,2] 



(125) 



where Hi3V3^i does not appear because it aligns with Hi2V2,i at Receiver 1. Now let us substitute 
the channels as well as beamforming matrices into the equation above, and rearrange the rows and 
columns, then we obtain: 



G 



/i2ia huh 0a 
/122a huh c 
/123a hr^h boo 



(126) 



where h 



iijii 



and is a 2 X 3 zero matrix. Furthermore, through an invertible linear 



transformation, G becomes: 



G' 



b a 
a b c 
a b 



(127) 



In order to see if G' has full rank, we only need to see if the following equation has non-zero 
solution: 



G'[\[ \l \l Xl Xl]" = 



(128) 



where A/GC^^^, I = 1,2, ■ ■ ■ ,5. The equation above imphes that 



aAs + bA2 = 
aAi + bA2 + CA4 = 
aAi + bAs = 0. 



(129) 



If we let A5 



Ai , Aa 



A2 and A4 = 0, then (129) can be equivalently simphfied as: 



aAi + bA2 



0. 



(130) 



Now it can be easily seen that G' is rank deficient because [a b] is a 5 x 6 matrix which has at 
least one-dimensional null space, and thus Ai,A2 can be non-zero vectors. Therefore, we cannot 
achieve 6/5 DoF per user using the linear beamforming schemes with symbol extensions over the 
constant channels. 

Remark: While we only show the infeasibility of linear beamforming schemes for the 2x3 setting 
using time extensions over the constant channels, in fact for all {M,N) = {p,p + 1) cases where 
p > 2, we can take similar invertible linear transformations at each transmitter and receiver, such 
that the resulting interference-carrying links are identity matrices. The proof of the infeasibility is 
similar to that for the 2x3 setting, and thus omitted here. On the other hand, although linear 
schemes cannot be applied to {Mt, Mji) = {p,p + 1) cases where p >2 over the constant channels, 
the DoF outer bounds can still be achieved by rational alignment proposed in [lOj . 

While the linear scheme with time extensions over constant channels fails to achieve the DoF 
outer bound for the setting 2 x 3, it does not imply that linear scheme is not optimal for this 
setting in general. In fact, the linear scheme is still sufficient to achieve the optimal DoF if the 
channel is time-varying or frequency-selective. To see this, let us consider Figure [16] again. Note 
that we can always obtain the resulting channel connectivity no matter if the channels are constant 
or time-varying/ frequency-selective. Therefore, the interference-carrying links are identical to that 
in (111), and Hkkit) stands for the direct channel matrices at the t*'* time slot. Again, consider 5 



symbol extension. Then the effective cross channel matrices become 



H 



H 



3 + i- 



:i31) 



Note that the direct channel cannot be expressed in the same manner since it varies over time or 



frequency although it is still a block-diagonal matrix. Then we can express the matrix G in (126) 
as 



R^ia Y{!l^h 0a 



R?oa R?2b 



^22' 

R§3a Rj^gb 



c 
b 



(132) 



where RJ^^' "n ^ {1,2,'i} , m G {1, 2} is given by 



R^ 



diag{[/lnm,(l) hnm{2) /lnm(3) /lnm(4) /l„m(5)]} 



(133) 



and hnm{t) = [tlu{t)]nm- Note that each entry of the diagonal matrix R„m is generic, and thus the 
rank deficient argument for the matrix G used for constant channel no long holds here. Moreover, 
through simple numerical simulations, we can easily verify G has full rank almost surely if we 
randomly pick the entries of a, b and c. Thus, 6/5 DoF per user can be achieved almost surely by 



using this non-asymptotical linear scheme if the channel coefficients are time-varying/ frequency- 
selective. 

Remark: It should be noted that the rational alignment scheme proposed for the constant 
channel in |10j can also be translated to the linear scheme for time- varying/frequency-selective 
channels to achieve the DoF outer bound. Such scheme does not explore antenna cooperations 
and achieves the outer bound asymptotically by using infinite symbol extensions. In contrast, the 
achievable schemes proposed above which explore antenna cooperation achieve the outer bound 
exactly with only a finite number of symbol extensions. 



8.3.2 A Linear Scheme vi^ith Symbol Extensions in Time/Frequency for General Cases 

In this subsection, we will construct a linear scheme with symbol extensions for general cases. The 
feasibility of such scheme can be settled in every case through a simple numerical test. Since the 
DoF value depends on either M or iV, we consider them separately. 
(1) d{M,N) = ^,M if2^<f 

Since the DoF outer bound is a fractional value, we take 2p — 1 symbol extensions to make 
the DoF value an integer, i.e., pM. Then over the extended channel, our goal is to achieve pM 
DoF. Note that after the symbol extensions, each transmitter has {2p — 1)M dimensions and each 
receiver has {2p — 1)N dimensions. The DoF value depending on M implies that the receiver 
includes redundant dimensions. Therefore, we randomly generate a {2p + 1)M x {2p — 1)N matrix 
at each receiver independently and multiply it to the channel seen at each receiver, such that each 
receiver effectively has a (2p -|- 1)M dimensional space. As a consequence, we have an effective 



((2p — 1)M, (2p-\-l)N) setting, for which interference alignment scheme introduced in Section 8.1.3 
can be applied here such that the dimension of the space spanned by interference is small enough. 
What remains to be shown is that the desired pM symbols do not overlap with the {p + 1)M 
interference dimensions. While we do not prove this statement in general, we provide the recipe 
for completing the proof subject to a numerical test. The independence of the desired signal space 
from the interference space is equivalent to the condition that the matrix containing the interference 
vectors and the desired signal vectors has full rank, i.e., the determinant of the matrix is non-zero. 
Since the determinant is a polynomial with the channel coefficients and the elements of the random 
projection matrix as the variables, there are only two possibilities. Either it is the zero polynomial 
or it is not. To prove that it is not the zero polynomial, it suffices to substitute any numerical 
values for all variables and show that the polynomial evaluates to a non-zero value. Then, since 
the polynomial is not the zero polynomial, it must almost surely be non-zero for generic values of 
channel coefficients and the projection matrix, thus completing the proof (subject to the condition 
that the numerical evaluation produces a non-zero value). 
(2) d{M,N) = ^,N if|-i<f <,-^ 

Similar to the previous case, consider 2p + l symbol extensions. Our goal is to achieve pN DoF 
over the extended channel. After the symbol extensions, each transmitter has {2p+l)M dimensions 
and each receiver has {2p -\- 1)N dimensions. Now we randomly generate a {2p + 1)M x {2p — 1)N 
matrix at each transmitter, and multiply it to the channel seen at each transmitter, such that each 
transmitter effectively has a (2p — l)A^-dimensional space. As a result, we end up with an effective 
{{2p — 1)N, {2p + 1)A) setting, for which interference alignment schemes introduced in Subsection 
|8.1.3| can be applied. Again we can apply numerical tests to verify if the desired signal overlaps 
with the interference. 

While we do not prove that the numerical test will produce a non-zero value for all M, A^, we 



have carried out the numerical test to complete the proof for all (M, N) values upto M, N < W 
as shown in Fig. [2} As we can see, linear schemes with symbol extensions over constant channels 
are sufficient to achieve the information theoretic DoF outer bounds for all (M, N) values upto 
M,N < 10 except for the {q,q+ 1) cases where time- variations/frequency-selectivity are needed as 
shown in Section 18. 3.11 



8.4 Feasibility of Linear Interference Alignment without any Symbol Extensions 
in Time/Frequency/Space 

In this section, we consider the feasibility of linear interference alignment for the 3 user Mt x Mpt 
MIMO interference channel. As stated in Theorem [2| the DoF demand per user, d, is feasible with 
linear interference alignment if and only if d < [DoF*J . The outer bound follows directly from 
Lemma [T] Next, we provide a proof of Lemma [2] to show that d = [DoF*J per user is achievable. 

Since DoF* is limited by either the M-bound or the A^-bound depending on M/N, we consider 
the two cases separately. We begin with the setting when < ^ < and show that [2^^-^] 
DoF per user is achievable using linear interference alignment without the need for symbol extensions 
in time/frequency/space. 



8.4.1 Case: |^ < # < ^ ^ ^ = L^^A^J : 

For this case, we will provide the achievable scheme for the case Mt = M and Mji = N. Due 
to reciprocity of linear schemes, such schemes can be applied to the case Mt = N and Mji = M 
as well. Let us first consider the case when A^ is an integer multiple of 2p + 1. In this case. 



^ ~ Up+i ^-l ~ 2p+i -^ which is an integer. As proved in Section 8.1, for this case, no symbol 
extensions are needed to achieve the information theoretic DoF outer bound. 

Now let us consider the remaining cases when A" is not an integer multiple of 2p + 1 . We first 
provide an intuition from the linear dimension counting perspective, and then show the rigorous 



proof through constructing specific channels as in Section 8.1 As shown previously, for l^qij < 



^ < the maximum length of the alignment chain is k = Ij^ztm] = P- Since the alignment 
chain with the maximum length corresponds to the most efficient alignment scheme, we would like 
the dimensions of the subspaces that participate in such chains to be as large as possible. Recall 
that if the dimension of the subspace is do , then the total number of dimensions transmitted from 
all transmitters is pdo and the total number of dimensions occupied at all receivers is {2p + l)cio- 
Due to symmetric antenna configurations, we can pack three such chains, each originating from one 
of three transmitters, as shown in (97), (100) and (103). Then each transmitter achieves pdo DoF, 
and {2p + l)do dimensions are occupied at each receiver. Since the number of dimensions at each 
receiver is A^, {2p + l)do cannot exceed A", implying that do < L^^j^J- Thus, do is set to be equal 
to Lsj^J- Aftsr this, each transmitter still needs to achieve [2^^-^] ~Pl2^{^\ DoF. This can be 
done if we can pack three more subspace alignment chains with length p' = Lg^^-^J ~ PL 2P+1 J ' 
each originating from one transmitter, and the dimension of the subspaces that participate in each 
chain is one. These symbols will occupy 2p' + 1 dimensions at each receiver. Note that this is 
possible if the total number of dimensions occupied by these six alignment chains is less than A^. 
In order to see this is true, we need to check that 2p' + 1 = 2([2^^A^J — pL2^^J) + 1 does not 
exceed the remaining dimensions at each receiver after accommodating the first three alignment 



chains with length p, i.e., N — [21^^] C^P + 
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(134) 

(135) 
(136) 



where ( 135| ) is obtained because is n ot an integer multiple of 2p + 1. Because 2p' + 1 and 
{N - l5ttJ(2p + 1)) are both integers, JTsej) implies that 2^' + 1 < (TV - L2^J(2p + 1))- As 



a result, each user can send [ 2^+1 -^] DoF and interference occupies small enough dimensions. 
Intuitively, the [2^^-^] vectors of each user should be linearly independent, almost surely, because 
the channels are generic and these vectors do not align among themselves unless they have to. Next 
we provide the proof to show this is true through constructing specific channels. 
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Figure 17: Linear Dimension Counting of Subspaces Participating in the Interference Alignment 
for the M X N setting (the values denote the dimensions of each corresponding subspace, and it is 
easy to verify each value is non- negative.) 



The linear dimension counting argument shown above is characterized in Figure 17 where we 
consider the signal subspaces at Transmitter 1, Transmitter 3 and Receiver 2. Specifically, we 
need to design six subspace alignment chains. Three of them are p-length [2]^] dimensional, 
for a total of p[ ^^j^ J dimensions at each transmitter, denoted as the blue color at Transmitter 
1 and Transmitter 3. Since three p-length [2]^] dimensional chains will occupy {2p + 1)L2]^J 
dimensions at each receiver, we need to align (p — 1) [ ^^^^ J dimensions, i.e., the blue color box 

dimensional subspace coming from each transmitter is 



N 
2p+l- 



at Receiver 2, and the non-aligned [ 

denoted as the adjacent grey color region. The other three chains are p'-length one dimensional, 
denoted as the yellow color region at Transmitter 1 and Transmitter 3. Again, since these three 



p'-length one dimensional chains occupy 2p' + 1 dimensions at each receiver, we need to ahgn p' — 1 
dimensions, i.e., the yellow color box at Receiver 2, and the non-aligned one dimensional subspace 
from each transmitter is denoted as the adjacent grey color region. Last, since Transmitter 1 and 
Transmitter 3 have a total of 2M—N common dimensions at Receiver 2 almost surely, the remaining 
two M — [ 2pj^i J dimensional subspaces (denoted as the green color) from these two transmitters 

have to have the remaining 2M — N — [ 2p^i J + [ 2^+1 J ^ dimensional intersection at Receiver 2 
(denoted as the green color), and the non-aligned N — M — [5^^] — 1 dimensional subspace from 



each transmitter is denoted as the adjacent grey color box. 



Let us first design the three length subspace alignment chains, which are shown in (97), (100) 



where each of three matrices A 
all have pM — {p— 1)N dimensions, and also because pM — {p — l)N > > [ 



and (103). These three chains yield the three alignment equations shown in (98), (101) and (104), 

, Bp, Cp is a (p — 1) X pM matrix. Since null spaces of Ap, Bp, Cp 

2^ > L2^J . we can choose 
2p+iJ basis vectors in the pM — {p — l-)N dimensional null spaces of Ap, Bp, Cp, 
respectively. That is, assuming Q^^p are three {pM — {p — l)N) x Ls^^J randomly generated 
matrices, then we have 



cip, bp, Cp as the 



N 



Ap^AA(Ap), Bp^AA(Bp), Cp^AA(Cp) 
3-p — ApQi p, bp — BpQ2,p) Cp — CpQsp 



(137) 



where A^(-) denotes the matrix whose columns span the whole null space of matrix (•). 

Next we design the three p'-length one-dimensional subspace alignment chains, which are still 
identical to (97), (100) and (103) by replacing p with p' . These three chains yield the three 



alignment equations shown in (98), (101) and (104) by replacing p with p' , where each of three 
matrices Ap/,Bp/,Cp/ is a (p' — 1)A^ x p'AI matrix. Since null spaces of Ap/,Bp/,Cp' all have 
p'M — {p' — 1)N dimensions, which is always no less than one, we can choose ap/,bp/,Cp/ as the 
basis vector in the p'M — (p' — 1)N dimensional null spaces of Ap/, Bp/, Cp/, respectively. Assuming 
Qa;,p' are three (p'M — [p' — V)N) x 1 randomly generated vectors, then we have 



Ap/^AA(Ap/), Bp/^AA(Bp/), Cp/=AA(Cp/ 
y = Bp/Q2,p/, Cp/ = Cp/Qs^p/ 



Hp/ — Ap/Qxp/ 



(138) 



Consider the square matrix of each receiver which consists of the desired signal and interference 
vectors. Now its determinant is a polynomial function of the channel coefficients and entries of 
Qfc,P) Qfc,p') A; = 1, 2, 3, and this polynomial is an either zero or non-zero polynomial almost surely. 
As in Section 8.1 we only need to construct specific channels as well as Qfc,p,Qfc,p', and show the 
beamforming vectors of each user are linearly independent. We choose the channel matrices as 
follows: 
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Oni xmi 
I 



mi xmi 
Olxrrai 







m2Xmi 
inaxmi 



•'max mi 



Oni xm2 
Omi xm2 
0lxm2 
Im2Xm2 
Ona xm2 
Oma xm2 



Oni xma 
Omi xma 
Olxma 







m2 xma 
•^naxma 



■-ma xma 



H 



■-mi xmi 



ni xmi 



•'m2 xmi 
Olxmi 







ma xmi 
^naXmi 



mi xm2 



"ni xm2 
Im2Xm2 
0lxm2 







ma X m2 
JnaXm2 







mi xma 
Orti xma 
0m2Xma 
Olxma 
ImaXma 
OrtaXma 



(139) 



where Vi G {1, 2, 3} and the values of m,, rij are shown in Figure 17 It can be easily verified that 
the alignment schemes we describe above produce one solution of the beamforming matrix for each 



transmitter as follows: 



V 



^m2Xm3 



0m3Xm2 



(140) 



where Vj.p and Vj_p. 



are obtained from the length [ ^^^^ J dimensional chains and p'-length one 
dimensional chains, respectively. Clearly, since the column spaces of Vj^p and Vj y are orthogonal 
to each other, the rank of Vj is m2 + m.3 = [ 2^+1 -^] • Therefore, the beamforming vectors of each 
user are linearly independent among themselves, almost surely. The linear independence established 
through this specific example proves that the polynomial (comprised of channel variables and Q 
variables) representing the determinant of a square matrix containing the beamforming vectors 
originating at a transmitter, is not the zero-polynomial. Since it is not the zero-polynomial, it is 
almost surely not zero for random choices of channel coefficients and Q matrices, i.e., the linear 
interference alignment solution exists almost surely. 



8.4.2 Case: ^ < f < ^ ^ = [^,M\ : 

For this case, we provide the achievable schemes for the setting Mt = N and Mn = M. The proof 
for this case is similar as the previous case with 2p + 1 and in the previous argument replaced 
by 2p — 1 and M, respectively. The detailed proof followed is omitted due to the similarity. ■ 



9 Conclusion 

In this paper we characterize both the spatially-normalized information-theoretic DoF as well as the 
DoF achievable through linear beamforming schemes without channel extensions in time/frequency/ 
space, for the symmetric three-user Mt x M/j Gaussian MIMO interference channel where each 
transmitter has Mt antennas and each receiver has M/j receive antennas. In order to establish 
this result, we derive information theoretic DoF outer bounds for arbitrarily values of Mt and M^. 
The information theoretic DoF outer bounds are facilitated by a change of basis operation at both 
transmitter and receiver sides which helps identify the projections of the transmitted signal space to 
be provided as genie signals for the outer bound arguments. One of the main ideas involved in this 
problem is the notion of subspace alignment chains, the length of which indicates the limitations of 
aligning interference symbols. Achievable schemes take advantage of the linear-dimension counting 
arguments and generic property of channels, both of which are captured by subspace alignment 
chains. 

Several interesting observations follow as a byproduct of our analysis. First we precisely identify 
settings with redundant dimensions at the transmitters, receivers, both or neither. The maximally 
redundant settings correspond to M/N = 1/2,2/3,3/4, ■■ ■ and contain redundant dimensions at 
both the transmitters and receivers. The DoF outer bounds essentially boil down to these settings. 
These settings are also the only ones where there is no DoF benefit of joint processing across 
the multiple antennas located at any transmitter or receiver node. The minimally redundant 
settings correspond to M/N = 3/5, 5/7, 7/9, • • • and contain no redundant dimensions at either the 
transmitters or receivers. The achievability results essentially boil own to these settings. These 
settings are also the only ones where proper systems are guaranteed to be feasible. 

We also note the recent work in j25j where partial achievability results are independently ob- 
tained and shown to be optimal in some cases with respect to linear interference alignment. To the 



best of our understanding, all the results of j25j can also be recovered as special cases of the results 
presented in this paper. 

Finally, we conclude with a pointer to the open problem of characterizing the DoF of asymmetric 
settings, where each transmitter and receiver may have different number of antennas. DoF results 
for certain asymmetric settings can be obtained directly from our results whenever the asymmetric 
setting differs from the symmetric case only in redundant dimensions. However, in general, the 
complexity of the asymmetric problem may be understood in light of the difficulty of packing 
subspace alignment chains within the space constraints imposed by the number of antennas at each 
node, which may be tight or redundant. Both outer bounds and inner bounds are challenging for 
this general setting. Dimension counting arguments, motivated by subspace alignment chains may 
be a good starting point for this general setting. 



Appendix 

A Information Theoretic DoF Outer Bound for Mt < Mr 

We will show the proofs in the following two subsections. In the first, we investigate the cases of 
M/N = p/{p + 1) for which we only need to consider (M, N) = (p,p+ 1) as we mentioned before. 
In the second subsection, we investigate the M/N ^ p/{p + 1) cases. 

A.l Cases: (M, iV) = {p,p + l)^ DoF < ^ 
A. 1.1 M is an Even Number 

We consider M is even in this subsection. We first take recursive invertible linear transformations 
introduced in Section [6] at each user. The transmitted signals from each antenna and what trans- 



mitted signals that each receiver antenna can see are specified in Fig, 18 , Note that again we use 
Sfcj^.) to denote received signal at the antenna (•) of Receiver k subtracting the signal carrying its 
desired message, which implies linearly independent combinations of the interference symbols at 
the antenna (•) of Receiver k. 

For the general (M, A^) = {p,p + 1) setting, as what have shown in Section [7| we need a total 
of M sets of genie signals and each set has M — 1 dimensions. We denote /cG{1,2,3}, mG 

{1, • • • , M} as the M sets of genie signals provided to Receiver k for the {M,N) = {p,p + 1) 
network. If = 1, or directly if without ambiguity is given by: 

for M = 2, gf = {X^aA 

then for M > 2, = {X^,^ , X^^ , G^-^} m = {1, 2, • • • , M - 2}, 

and Gtl, = , , 1 1 < / < L - 1}} 



= {Xg, , {Xg, , Xg^ 1 1 < / < L - 1}} (141) 



and Q2rn^ ^Im ^c obtained by advancing the user indices. It is easy to check that the cardinality 
of each set is M — 1. Also, note that if Receiver 1 knows the two signals (^2 af. ? "^ 3cf.) 
L^^ layer, then after removing (Xg^^jX^,^) from ^ ^ {I)""" ^ M — 2} in (141), we obtain 



Gm ^) ^ {!)■■■ )-^~ 2}. This is in fact essential why we can design the genie signals in 
an iterative way, which help us recursively derive the DoF outer bound based on mathematical 
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Figure 18: Intuition of Onion Peeling if M is even 



induction. Consider an {M,M + 1) interference network, which has a total of L = M/2 layers, 
with two transmit signals {XJ^^^ , XJ!^^) at the l^^ layer where I = {1,2, ■ ■ ■ ,L}. The transmit signals 
in the l''^ layer will be heard by all antennas in all I' < I layers. Now let us peel the L^^ layer 
at both sides, i.e., a genie provides the two symbols (-^(^^^)^^, ^(^_]^)^^) to Receiver k. Since the 
peeled 5^^^ and S^^^ at Receiver k are already noised versions XJj^_^^^^ and XJj^_^-^^^^ respectively. 
Receiver 1 can recover {XJ^i^_^-^^^^^, X^^^^-^^^, XJj^_-^^-^^^, X'^j^_^s^^^) subject to the noise distortion, and 
thus it can subtract them from the received signals at the other M — 1 antennas. Therefore, we 
obtain an embedded (M — 2, M — 1) interference network. 

The proof is based on mathematical induction. Since we have already finished the proof for 
(M, M + 1) = (2, 3) and (4, 5) previously, now let us assume it works for the (M — 2, M — 1) case. 
That is to say, by providing genie signals Q^~'^, m E {1, • • • , M — 2} to Receiver 1, we obtain a 
total of M — 2 sum rate inequalities, each obtained by averaging over user indices. If we add up 
all these [M — 2)-inequalities, at the left-hand side we have (M — 2)nR; at the right-hand side we 
have {M — 2)N\ogp + (M — 3)nR + n o(logp) + o(n). In other words, we can bound the sum of 
differential entropy of all genie signals provided to three receivers by: 

M-2 3 

3 E E h{GkL~'\Yk) <iM- S)nRj: + n o(logp) + o{n) (142) 

m=l k=l 

where | Ylk=i stands for averaging over user indices and hereinafter. 

Next let consider the {M,M + 1) case, i.e., adding one layer to the previous network. Since 
by providing iXVj^_^^^^^ ^■^(k~i)c ) Receiver k, we can boil down the {M,M + 1) setting to the 



(M — 2, M — 1) setting. By our assumptions, we can easily obtain: 
^ M-2 3 



3 

m=l fe=l 

1 ^ 

(M - 3)- ^ X,",J1 < Z < L - + n o(logp) + o(n). (143) 

k=l 

For the (M, M + 1) case, we consider the sum differential entropy of all genie signals provided to 
all receivers in the first M — 2 sets conditioning on the observations of each receiver, respectively. 
That is, 

M-2 3 



m—l k—1 
M-2 3 

= X! X! {^'^(^lk+l)aL^^(k-l)cL\^k) + HSkL\{^lk+l)aLi^^^ (144) 
m=l fe=l 

3 M-2 3 

= (M-2)^/i(X(",+,)„^,X(Vi)ejn") + EE'^(^fe-\{^^fc+l)a.'^(Vl)cJln^^(l+l)a.,^(Vl) 

k=l m=lk=l 
3 3 

< EM^a+i)a.,^rfe-i)cj + (M - 3) E (m^(I-i)cJ + M^(i+i)aj^a+i)cj) 
fe=i fe=i 

M-2 3 

+ E E^(^fc- \ {^(l+l)a.'^(Vl)cJin",^(l+l)a.>^(Vl)cJ (146) 
m=l fc=l 

3 3 

) + (M-3)E(M^( 

fe=l fe=l 
3 

+(M - 3)n E /^({^fea, , ^fc"cj 1 < « < i - n\Xka, , ^Ic, ) + n o(log p) + o(n) (147) 

3 

= E /^(^a+Da.'^a-DcJ + r^ o(logp) + oin) 

k=l 

3 

+(M - 3) E (M^(l+i)a.>^(l+i)cJ + /^({^Lp^fccjl < i < i - l}|X,V,^Lj) (148) 

fc=l 

3 3 

< E(M^(Vi)aJ + M^(Vi)cj) +(^-3)EM{^L,,^."cJl<^<i})+«o(logP^ (149) 
fe=l fc=l 

3 

= E {HX^aJ + h{X^,J) +{M- 3)ni?E + n o(logp) + o(n). (150) 
fe=i 

Therefore, the summation of the M — 2 sum rate inequalities produce the following inequality: 

3(M - 2)nR <{M - 2)Nn log p + (M - 3)ni? 
1 ^ 

+ 3 E (^(^fcaj + KX^cJ) + " o(logp) + o{n). 
k=l 



Or equivalently it can be rewritten as: 

3(M - 2)nR < (M - 2)Nnlogp+{M - 3)nR+{h{X^^) + h{X^J) +no{logp) + o(n). (151) 

For the remaining last two genie signal sets, if a genie provides Gm-i = {^2a£> {"'^2ai> ^2cjl — 
I < L — 1}} to Receiver 1, we have: 

ni?E < I{Wi,W2, Ws- Y^,Qfi_i) + n o(logp) + o{n) (152) 

< iVnlogp + /i(glf_i|Yi") + n o(logp) + o(n) (153) 

< Nn\ogp + h{G^_^\X'^^J + n o(logp) + o(n) (154) 

< Nnlogp + nR2 - h{X^^J +n o(logp) + o{n) (155) 

and thus by averaging over user indices, we have the (M — 1)*'^ inequality: 

3nR < Nnlogp + nR- h{X';^J + n o{logp) +o{n). (156) 

With similar analysis if a genie provides G^-i ~ i-^ScL^-^Sai^ -^Scil^ <l < L — 1}} to Receiver 1, 
we have the M*'^ inequality: 

3ni? < iVn log p + ni? - /i(X") + n o(logp) + o(n). (157) 



Add up the inequalities of (151), (156) and (157), we eventually obtain 



3Mni? < MN\ogp+ {M - l)nR + n o(logp) +o(n), (158) 

which implies that the DoF per user outer bound 

MN MN , , 

Therefore, we establish the outer bound results. ■ 
A. 1.2 M is an Odd Number 

For (M, M + 1) case where M is odd, the proof for the DoF outer bound can be carried out in a 
similar way as what we have shown if M is even. Specifically, the total number of layers is still 
equal to L where M = 2L + 1. By peeling out the layers one by one, we eventually obtain the 3x4 
core. The interference signallings comprised at the received signal at each antenna after the linear 
transformations is shown in Figjl9[ 

For this case, we will provide M-sets of genie signals to each receiver, each set with M — 1 
dimensional signals. Again, we show the genie provided to receiver as follows, and the genie signals 
provided to Receiver 2 and 3 can be obtained by advancing the user indices. 

for M = 3, gf' = {X^a„XlA 

^3 — i-^36i'-^3ci/ 

then for M > 3, = {^2^ , , G^-^] m = {1, 2, • • • , M - 2}, 

and gl^i = {Xl^a,,{X^a„Xl^c,\^ <1<L- 1},X^,J 

GM = {Xl^,{XSa,,Xl^\l <1<L- 1},X3\} (160) 



The remaining proof is the similar as that if M is even by replacing the genie signals Gm in ( 141 ) 



with that shown in (160). 
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Figure 19: Intuition of Onion Peeling if M is odd 
A.2 DoF Outer Bound for f ^ ^ 

In this subsection, we only show the information-theoretic DoF outer bound proofs for ^ 

In fact, all the derivations follow directly from what we have shown for M/N = p/{p + \). We will 

first show some examples and then extend the analysis to the general cases. 

A.2.1 Case: Any M/N > 2/3 DoF < ^ 

In this section, consider arbitrary {M,N) values such that M/N > 2/3. For all such values of 
(M, N) , the DoF outer bound that holds is d < ^ . In order to keep the presentation clean and 
simple, from now on we will use tables instead of figures to show the channel connectivity. Note 
that the linear transformation still follows the similar manner as that introduced in Section |6l 



\Xia\ = (N-M) 


Xia 





\Xib\ =3M-2N>0 


Xu 





\Xi,\ = {N-M) 


Xlc 









SlaiX^a) 


\Sla\ 




M) 





SlbiX2a, X2b, X2C, X^ajXab, X^c) 


\Slb\ 


= 2M- 


- N >(N - M) 





Slc{X2c) 


\Slc\ 




M) 



\X2a\ = {N-M) 


X2a 





\X2b\ = 3M- 2iV > 


X2b 





1X2,1 = (N-M) 


X2c 









S2a{Xia) 


\S2a\ 


= {N- 


M) 





S2b{X3a, X^b, X^c, Xia, Xib, Xic) 


\S2b\ 


= 2M- 


^ N>{N - M) 





S2c{X3c) 


\S2c\ 


= {N- 


M) 



|^3a| = (^-M) 


-^3 a 





|X3b| = 3M- 2iV > 


Xzb 





1X3,1 = (TV -M) 


^3c 









"5*30(^20) 


\S3a\ 


= {N- 


M) 





'5'36(-^la, Xib, Xlc, X2a, ^26, X2c) 


\S3b\ 


= 2M- 


- N>{N- M) 





Ssci^lc) 


\S3c\ 


= (iV- 


M) 



In the table above, notice that one circle could represent more than one antennas. For simplicity 
we still use X to denote the signal vector at corresponding antennas if without ambiguity and 
hereinafter. 

First a genie provides Qi = {X^jjXgj,} to receiver 1. Then the total number of dimensions 
available to receiver 1 (including those provided by the genie) is equal to: 

N + \Gi\ = N + + = N + {N -M) + (3M - 2A^) = 2M 

With these (at least) 2M dimensions, it is easy to see that receiver 1 is able to resolve both 
interfering signals and thus it can decode all three messages. Therefore, we have: 

< Nn\ogp + h{Xl^,,Xli,\Y^) + no{\ogp)+o{n) (161) 

< Nn\ogp + h{Xl^,,Xl^,\Xl^,) + no{\ogp) + o{n) (162) 
= Nn log p + ni?2 - KX2c) + n o(log p) + o(n) (163) 

By advancing user indices, therefore we have: 

3ni2 < iVn log p + nR - h{X]^) + n o(logp) + o{n). (164) 

Second a genie provides Q2 = {X^^^,X^^ to receiver 1. Then the total number of dimensions 
available to receiver 1 (including those provided by the genie) is equal to: 

AT + 1^2! = + |^3bl + \X^c\ = N + (3M - 2N) + {N -M) = 2M 

Thus, receiver 1 is able to resolve both interfering signals. Therefore, once again, we have: 

niis < Nn\ogp+h{X^^,,X'^^\Y^)+no{\ogp)+o{n) (165) 
< Nn log p + /i(XJJ + /i(X3"J + n o(log p) + o{n) (166) 
= Nn log p + (3M - 2N)n log p + h{X^^) + n o(log p) + o(n) (167) 

and therefore we have: 

3nii < Nn log p + (3M - 2N)n log p + /i(X^") + n o(log p) + o(n) (168) 



Adding up the inequalities in (164) and (168) we obtain: 

QnR < 3AIn log p + nR + n o(log p) + o{n) 

which implies that 

, 3M 
- 5 

A.2.2 Case: Any M/N £ [1/2,2/3] ^ DoF < ^ 

In this section, consider arbitrary {M,N) values such that M/N E [1/2,2/3]. For all such values 
of (M, N), the DoF outer bound that holds is d < 

We still take the linear transformation introduced in Section 4 first at the receiver side. In 
addition, we take linear transformation at the transmitter side by multiplying an M x M square 
matrix at transmitter k which is the inverse of the channel matrix from X^ to (^(fc-i)fe, 5^(A;-i)c)- 



This operation will force ^(^-1)0 only see the signals of (-^f )[(2M-Af+i):Af] where denotes the 

m*^ to n*'* entries of the signal vector X and hereinafter. The resulting network and corresponding 
connectivity are present in the following table. 
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M) 
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\Sib\ 
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-N <{N -M) 







Slc{X2) 


\Slc\ 


= iN- 
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S2a{Xl) 


5*20 


= {N- 


M) 


IX2I = M 










S2b{X-i,Xi) 


\S2b\ 


= 2M - 


-N <{N - M) 







S2c{X^) 


\S2c\ 


= iN- 


M) 








5*30 (-^2) 


5*30 


= {N- 


M) 


Xz\ = M 


Xs 








'S'36(-'^l, -^2) 


1^361 


= 2M - 


-N <{N - M) 







53c(^l) 


5*30 


= iN- 


M) 



First a genie provides Qi = {X2 



[1:{N-M)] 



to receiver 1. Then the total number of dimensions 



available to receiver 1 (including those provided by the genie) is equal to: 

N + \gi\= N+{N- M)>3M - M = 2M 

With at least 2M dimensions among them, it is easy to see that receiver 1 is able to resolve both 
interfering signals. Therefore, we have: 

ni2s < Nnlogp + h{{X^\i.,^N-M)]\Yr) + no{logp) + o(n) (169) 
<Nnlogp + hi{X'^)[^,^N_M)]\{X^)[(N~M+i):M]) + noilogp) + oin) (170) 
= iVnlogp + nR2 - hi{X^)[^^_M+iy.M]) + n o{\ogp) + o{n) (171) 



where (170) follows from dropping condition terms does not decrease the capacity. Specifically, 
^(fc-i)c only see the signals of (^2 )[(2M-Af+i):A/]- Since we are considering ^ < ^ < | which 
implies that 3M < 2N , we have {2M - N + I) < [N - M + I). In other words, we only keep the 
last 2M — entries of Yi in the condition and drop the other terms. By advancing user indices, 
therefore we have: 



2,nR < Nn\ogp + nR - /i((^"')[(Ar_Af+i):Af]) + ™ o(logp) + o{n). 



(172) 



Second a genie provides Q2 = (-'^3')[(Ar-A'/+i):A'/] to receiver 1. Then the total number of dimen- 
sions available to receiver 1 including those provided by the genie is equal to: 



N +\Q2\ = N + {M - {N - M + 1) + 1) 



2M 



With these 2M dimensions, receiver 1 once again is able to resolve both interfering signals. There- 
fore, we have: 



ni?E < Nn\ogp + h{{X^) 

[{N~M+l):M]\Yl ) + ^ o(log/3) + o{n) 

< Nnlogp + h{{X^)i(^N~M+iy.M])+n o{\ogp) + o{n) 



(173) 
(174) 



By advancing user indices, therefore we have: 

3nR < Nnlogp + h{{X'')[^N_M+iy.M]) + n o(logp) + o(n) 



:i75) 



Adding up the inequalities in (|172|) and (|175|) we obtain: 
which imphes that 



6ni? < 2Nn log p + nR + n o(log p) + o{n) 



d < 



2N 



DoF < ^ 



A.2.3 Case: Any M/N > 4/5 

In this section, consider arbitrary {M,N) values such that M/N > 4/5. For all such values of 
(M, N), the DoF outer bound that holds is d < 

After the linear transformation that we introduce in Section 4, the resulting network and channel 
connectivity are shown in the following table. 
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\S^A=N-M 
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SlC2 {X2C2) 
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'S'2a2 (-^^102 ) 





'S'2ai {Xlai , -''^102 J -^^102 I -^^302 7 -'^3c2 ) 





'S'261 (-''^3 J -''^l ) 





S2C1 {Xsci 7 -^^102 I Xlc2 7 -''^302 7 X3C2 ) 





'S'2C2 (-'^3C2 ) 



-^3a2 





-^3ai 





-^^361 





-^^301 





-^^^302 









'S'3a2 (-^^202 ) 





Saai {X2ai , X2a2 7 -^2c2 7 -^^102 7 -^^102 ) 





'S'361 (-'^^1, X2) 





S3,ci {Xic^ , X2a2 1 X2C2 7 -^102 7 Xic2 ) 





'S'3C2 {X1C2) 



First a genie provides Qi = {^2a2-' ■^Sc2i -^"lai-i -^-ib } *o receiver 1. Then the total number of 
dimensions available to receiver 1 (including those provided by the genie) is equal to: 

N + \g^\ = N + + \x^,^\ + 1X2X1 + \^2h\ 

= N + {N -M) + {N - M) + {N -M) + (5M - 4A^) = 2M 

With these 2M dimensions, receiver 1 is able to resolve both interfering signals. Therefore, we 
have: 

ni?s < Nn log p + HXl^,^ , X^,^ , X^,^ , Xq,^ \Y^) + n o{\og p) + o{n) (176) 

< Nn log p + h{Xl^^ |Fi") + h{Xl^,^ \Yn + h{Xli,^ , Xl^,^ , X^i,^ , X^J + n o(log p) + o{n) (177) 

< Nn log p + h{X^^^ ) + h{Xli,^ 1X2",^ ) + h{Xl^^^ , X^i,^ 1X2",^ , XJ^^^ , Xl^ ) + n o(log p) + o{n) (178) 



Nn log p + h{Xl^ ) + nR2- h{X^,^ ) 



h{Xl^\X'2\, 



X^C2) + noi\ogp) + o{n) 



(179) 



and by advancing user indices, therefore we have: 

3nfl < Nn log p + nR - h{Xl \Xl^ , X^^ ) + n o(log p) + o(n) . 



(180) 



Second a genie provides Q2 = {^202' ^3c2' "^3fe '"^Scii *o receiver 1. Then the total number of 
dimensions available to receiver 1 (including those provided by the genie) is equal to: 

N + \g,\=N + \X5J + \XIJ + 1X3X1 + l^3cj 

= N + {N - M) + (N - M) + (5M - 4A^) + {N - M) = 2M 

With these 2M dimensions, receiver 1 is able to resolve both interfering signals. Therefore, we 
have: 

< Nn log p + h{X^,^ , X^^ , XJ,^ , X^^ | Yi") + n o(log p) + o(n) (181) 

< Nn log p + h{X^,^ ) + h{XS,^ ) + h{Xl\^ ) + hiX^,^ \X!,\^ , X^,^ ) + n o(log p) + o(n) (182) 

< Nn log p + /^(X^",, ) + h{Xl^ ) + (5M - 47V)n log p + h{Xl^ , X^^ ) + n o(log p) + o(ni 183) 

and by advancing user indices, therefore we have: 
3nR < (5M - 3N)nlogp + nR + /i(X^J + h{X^^) - hiX^jX^^, X^^) + n o{\ogp) + o(n). (184) 

Third a genie provides ^3 = {Xg^^ , -^2ai > "^^26 i"'^2ci} receiver 1. Then the total number of 
dimensions available to receiver 1 (including those provided by the genie) is equal to: 

N+\gi\= N + {N- M) + {N- M) + (5M - 4iV) + [N -M) = 2M 

With these 2M dimensions, receiver 1 is able to resolve both interfering signals. Therefore, we 
have: 



nRj, < Nn log p + h{X^,^ , X^,^ , X^,^ , X^^ \Y{^) + n o(log p) + o(n) 
< Nn log p + /i(X2",, , X^^^ , X2",^ , ^2",^ \Xl^) + n o(log p) + o(n) 
= iVn log p + ni?2 - h{X^^^) + n o(logp) + o(n). 

By advancing user indices, therefore we have: 

3nR < Nnlogp + nR- h{X^^) + n o(logp) +o(n). 



(185) 
(186) 
(187) 



(188) 



Last a genie provides ^4 = {XJ,^, Xg^^, Xg^^, to receiver 1. With the similar analysis 
shown above, we obtain 



3nR < Nnlogp + nR - h{X^^) + n o(logp) + o(n). 
Adding up the four inequalities in p80| ), ((l84]), ([188]) and ( fl89l ) we obtain: 
12nR < 5Mn log p + 3nR + n o(log p) + o(n) 

which implies that 



(189) 



A.2.4 Case: Any M/N € [3/4,4/5] => DoF < ^ 

In this section, consider arbitrary {M,N) values such that M/N G [3/4,4/5]. For all such values 
of (M, N), the DoF outer bound that holds \s d<^. 

With the linear transformation at both transmitter and receiver sides, we have the following 
table representing the network and corresponding connectivity. 
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S2bi Xi) 
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S2C1 i^Sb, -^3a2 7 -'^3C2 7 -^^102 7 ^1C2 ) 









S2a2 {X3C2 ) 










*S'3a2 (-^^202 ) 


-^^302 










'S'3ai (-^^267 -''^102 7 ^1C2 7 ^2a2 7 -'^2c2 ) 


-'^36 










Sshi (-^^17 -^^2) 


X3C2 










•S'sci (-''^167 ^la2 7 ^1C2 7 -^^202 7 -'^2c2 ) 









'S'3C2(-'^1C2) 



Similar to M/N G [1/2, 2/3] case, we at last multiply at the transmitter k a square matrix which 
is inverse of the channel matrix from X^b to (^(fc-i)fei, ^(fc-i)ci) for k £ {1,2,3}. This operation 
will help us only keep the necessary condition terms when we bound the sum rate of three messages, 
as what we have shown in M/N G [1/2, 2/3] case. 

First a genie provides Qi = {X2a.^, X^^^, {X2f/)[i;(N-M)]} to receiver 1. Then the total number 
of dimensions available to receiver 1 is equal to: 

N +\gi\ = N + {N - M) + {N - M) + {N - M) = AN -3M >2M 

With at least 2M dimensions among them, receiver 1 is able to resolve both interfering signals. 
Therefore, we have: 

ni?s < Nnlogp + h{XS,^,Xl^,{X^,)[,,^^_M)]\Yn+n o(logp) +o(n) (190) 

< Nnlogp + hiXlJ + hiX^jX^J + /i((X2",)[i,(^_M)]ln"7^2a2'^3c2) + ^ "(log p) + o(n)(191) 

< m2\ogp + hiXlJ + hiX^jX^J + h{{X^,)[,,^N_M)]\iX^bkN-M+i):M],X^,^,X^J 

+n o{\og p) + o{n) (192) 

= Nnlogp + hiXlJ + nR2 - ^X^J - /i((^2"fc)[(iV-M+l):(3M-2Ar)]|^2"a27^2"2) 

+n o{\og p) + o{n) (193) 



where ( 192 ) follows from dropping condition terms does not decrease the channel capacity. Specif- 
ically, with X2a^,X^^^ and "^laa (-'^saj)' '^1^2 (-^2c2)' Subtract them from Si^ and thus only 



leave a clean ^26- Since we have invert the associated channel at the transmitter 2, we can only 
keep the term {X2i,)[[n-m+i):M] ™ the condition. By advancing user indices, therefore we have: 

3nR < Nnlogp + nR - /i((Xfe")[(^_M+i);(3A/-2iV)]l^a2,^cJ + ^ o{logp) + o(n). (194) 

Second a genie provides ^2 = {X2a2^ ^3c2^ i^3b)l{N~M+i):{3M-2N)]} to receiver 1. Then the 
total number of dimensions available to receiver 1 is equal to: 



AT + 1^2! = N + {N - M) + {N - M) + ((3M - 2iV) - (A^ - M + 1) + 1) 



2M 



With these 2M dimensions, receiver 1 is able to resolve both interfering signals. Therefore, we 
have: 

< Nn\ogp + h{X^,^,Xl^,iX!^,\^N_M+m3M-2N)]\Yn+no{\ogp) + oin) (195) 

< Nnlogp + hiX^,^,XlJ + hi{Xl)i^^_M+iy.i3M-2N)]\Yr,X^^^,Xl^^ 

< Nn\0gp + h{Xq,^) + h{XJ^,^) + /l((^3"fc)[(iV-A/+l):(3Af-2Ar)]|^3"a.,^3cJ + « o(log p) + o{nlm) 

and by advancing user indices, therefore we have: 

ZnR < Nnlogp + /^(X^J + h{Xl) + /i(Xn[(7V-Af+i);{3Af-2JV)]l^a" .^c") + ^ o(log p) + o(n).(198) 

Third, if a genie provides = {^2a2' "'^S)} to receiver 1. Then the total number of dimensions 
available to receiver 1 (including those provided by the genie) is equal to: 

N +\gi\ = N + {N - M) + (3M - 2iV) = 2M 

With these 2M dimensions, receiver 1 is able to resolve both interfering signals. Therefore, we 
have: 



ni?E < Nn log p + h{X^,^ , X^,]?;") + n o(log p) + o{n) 
< Nnlogp + nR2 - h{X2c2) + n o(logp) + o(n). 

By advancing user indices, therefore we have: 

3nR < Nn\ogp + nR- h{X'^^) + n o(logp) +o(n). 



(199) 
(200) 



(201) 



Last a genie provides ^4 = {X'^^,X^^^ to receiver 1. With the similar analysis shown above, 
we obtain 



3ni? < Nn log p + nR- h{X'^^ ) + n o(log p) + o{n) . 
Adding up the inequalities in ( |194[ ), ( |198[ ), ( |201| ) and ( |202| ) we obtain: 
12ni2 < ANn log p + 3nR + n o(log p) + o(n) 

which implies that 

4iV 



(202) 



d < 



9 



A.2.5 Case: Any M/N > DoF < 

For this case, the resulting network and channel connectivity after the linear transformation are 
shown in the following table. 
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We denote G^, m G {L • ■ • , 2L} as the the 2L sets of the provided genie signals to receiver 1 for 
the cases we consider, which can be written in an iterative form as follows: for m' = {1,2, ■ ■ ■ , L} 
where L is the total number of layers, 

GiL'-i = {{XEa,,XZ,\m' + 1<1< L},X^,^„{X^,^,Xl^\l <l<m'- 1},XIJ 

Qli' = {{X^a^,Xl^\m' + 1<1< L},Xl^„{X^,^,XZ^\l < I < m' - 1},XS,J (203) 

For each set shown above, the total number of dimensions available to receiver 1 including the 
dimensions provided by the genie is equal to: 

AT + \g^\ = N + {N- M)[2{L -!) + !] + [{2L + 1)M - 2LN] = 2M. 

Similar to the proof shown in Appendix A.l, we still use mathematical induction to prove the 
general result. Due to the similarities between the proofs in this subsection and in Appendix A.l, 
we will only highlight their difference. 



With the intuition of onion peeling, we have a total of L layers at each user in this case. For 
the l*^ layer where 2 < I < L, there are two groups of signals i^kai' -^kci) ^^^^ ^ with the 
cardinality \X^^ \ = \XJ^^ | = — M, while in in the first layer, there are three groups of signals 
with the cardinality \X^J = |X- J = iV - M and = (2L + 1)M - 2LN. 

Since we have proved for L = 1, 2 cases previously, now let us assume it works for the L — 1 
case. That is to say, by providing genie signals Qm^ ^\ m G {1, • • • , L — 1} to receiver 1 and 
by advancing user indices, we obtain a total of (2L — 2)-rate per user inequalities. If we add up 
all these inequalities, at the left-hand side we have 3(2L — 2)nR; at the right-hand side we have 
{2L-2)Nnlogp+ [{2L + 1)M - 2LN]nlog p + {2L - 3)nR + n o{log p) + o{n) . In other words, we 
can bound the sum differential entropy of all provided genie signals to three users above by: 

2L-2 3 



Yl YH^km~^\^k) < [{2L + 1)M -2LN]nlogp + {2L-3)nR + n o{logp) + o{n). (204) 

m=l k=l 

Thus, if we add the L^^ layer, the resulting summation of rate outer bounds provided by the first 



2L — 2 inequalities, as shown in (151), in this case becomes: 



3(2L -2)nR< (2L - 2)Nn log p + [{2L + 1)M- 2LN]n log p + {2L - 3)nR 

+h{X:^ ) + h{X:^ ) + n o(log p) + o{n) (205) 
= [{21 + 1)M - 2N]nlogp+ {2L ~ i)nR + h{Xl^^) + /i(X^^J + n o(logp) + o(n).(206) 

Next, if the genie provides the last two sets of signals Q2L-1 ^'^^ ^2L receiver 1, respectively, 
we can easily obtain the last two inequalities as: 

3nR < Nn log p + nR- h{X^^ ) + n o(log p) + o(n) (207) 
3nR < Nn log p + nR- h{X'^^ ) + n o(log p) + o{n) . (208) 



Add up inequalities in ( |206 ), (207) and (208), we eventually obtain 



6LnR< {2L + l)Mnlogp + {2L-l)nR + n o{logp) + o{n), (209) 
which implies that the sum DoF outer bound 



(210) 



A.2.6 Case: Any M/N G [' 
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With the intuition of onion peehng, we have a total of L layers at each user in this case. For 
the Z*'* layer where 2 < I < L, there are two groups of signals {XJ^^^, XJ^^^) for user k with the 

N — M, while in the first layer, we only have X^j,^ with the cardinality 



cardinality \XJ^ 



I I 



= (2L - 1)M - (2L - 2)iV. 
We denote G^, m G {1, • • • , 2L} as the the 2L sets of the provided genie signals to receiver 1, 
which can be written in an iterative form as follows: 



for 



m 



r2L 

y2m' 



-1 

y2m' 

for m' 

p2L 
y2m'-l 



r2L 

y2m' 



1, 

{{X^a^^Xgy + 1<1<L}, {X^,\^..^N-M)]} 

{{^2a,)-'^3cJ"^' + '^<l < L}, iX^b)[{N-M+iy.{{2L-l)M-{2L-2)N)]} 
{2,3,--- ,L}, 

{{X^arXl,\m' + 1<1< L},{X^,^,X^,^\2 <l<m'- 1}, X^",^, , X^U 
{{XS,^,Xiy + 1<1< L},{Xl^,Xl^\2 <l<m'- 1},XS,^„X^,} 



(211) 



For each set shown above, the total number of dimensions available to receiver 1 including the 
dimensions provided by the genie is equal to: 



N + \gf^\ =N + {N - M)2{L -1) + {N -M)>2M 



N + = N + {N - M)2{L - 1) + [((2L - 1)M - (2L - 2)N) - (iV - M + 1) + 1] = 2M 



N + l&^^l =N + {N - M)2{L -2) + {N -M) + [{2L - 1)M - (2L - 2)iV] = 2M for m > 3. 



The rigorous proof is still based on mathematical induction. Since we have shown the proof for 
L = 1, 2, the remaining part directly follows from what we have shown in Appendix A.l by 



replacing the genie signals sets with that in (211) 



A.2.7 Case: Any M/N > |^ DoF < 
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The proof for this case still directly follows what we have shown in Appendix A. 2 and B.1.1. 
The only difference is the first set of signals provided by the genie. Specifically, we write out the 



genie signal sets as follows: 

g^L+l ^ {{X2„^,X3^Jl <1<L}, (-'^3fej)[l:({2L+2)Af-{2L+l)Ar)]} 

and for m' = {2, 3, • • • , L}, 

^2^^' = {{^2",,^2j"i' + 1 < ^ < L},{X^^^,Xl^\2 <l<m'- 1},X^^^,,X^,} 

= {{X^ar^3c,\m' + 1 < / < L},{Xl^,Xl^\2 <l<m'- 1}, Xg",^,, Xg",} (212) 

Note that if we peel out all the l*'^ layers where / > 2, the aim of the first set of signals provided 
by the genie, e.g., the example {M,N) = (3,4) in Section 4.1.2 and Appendix A. 2, is to produce 
the following terms 

iVnlogp + hiX^J{X^,^\2 <1<L}) + hiXg^\{Xg^\2 < I < L}) + n o(logp) + o(n) (213) 

on the right-hand side of the inequality, where the intermediate terms h{X2a-i^\{X2a |2 < / < L}) 
and h{X^^^\{X^^^\2 < I < L}) can be be canceled by the summation of the remaining 2L inequalities 

(by providing G^^^, 2 < m < 2L + 1) on the right-hand side. In this case, however, because Qf^^^ 
includes an extra signal {X!^^_^)[i.(^(^2L+2)M-(2L+i)n)] which will produce an extra term ((2L + 2)M — 
{2L-\-l)N)nlogp in ( 213| ). Therefore, following the idea of previous proofs, by adding up the total 
of 2L + 1-inequalities, we can obtain: 

3{2L + l)nR < {2L + l)Nn log p + {{2L + 2)M - {2L + l)N)n log p + 2LnR + n o(log p) + o{n) 
which implies that 

, 2L + 2_ 

d < — M. 

- 4L + 3 

A.2.8 Case: Any M/N E [3!^, ^] ^ DoF < |^iV 

The proof for this case is identical to that in Appendix A. 1.2 by only noting \Xkai I = \^kci I = N—M 
where / = 1, 2, • • • , L and \Xkbi | = (2L + l)M - 2LN . 



B Information Theoretic DoF Outer Bound for Mt > 

In this section we consider the DoF outer bound for > M/;, i.e., the N x M setting. Note 
that the linear transformation for the {N, M) case is still identical to that for the (M, N) case 
that we introduce in Section [6] but in a reciprocal manner. Therefore, we directly show the table 
representing each resulting network and corresponding channel connectivity for each case without 
specifying the linear transformation process in this section. 



B.l Outerbound Proofs around M/N ratios 2/3, 4/5, 6/7, • • • 

Consider 3 user N x M MIMO interference channel, i.e., with N transmit antennas and M receive 
antennas for each user. We assume M < N throughout. 



B.1.1 Case (A^, M) = (3, 2) DoF < | 
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o 




X2a 
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X2c 
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Xza 
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Xsc 
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Sla{X2a-, X2b, 
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Slc{X2b, X^b, Xsc) 
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S2a{X3a, X^b, Xib) 


o 


S2c{X3b, Xib, Xic) 




o 


SsaiXla, Xib, X2b) 


o 


SsciXib, X2b, X2c) 



First, a genie provides Qi = Xg^,, Xgf,, Xg^) to receiver 1: 

nRj: < I{Wi,W2,W3;Y^^,gi)+no(\ogp)+oin) (214) 

= I{WuW2,W3-,Y^^)+IiWuW2,W3-,gi\Y{') + no{logp) + oin) (215) 

< Mn log p + h{X^,, XI) + h{Xl^,, + n o(log p) + o{n) (216) 

^?>nR < Mn log p + h{X^,Xj^) + h{Xl^,X^) + no{logp) + o(n) (217) 

The symbol ^ stands for "follows from symmetry" that we have applied in previous section. 
Second, a genie provides ^2 = (^2,-'^3a) = (-'^Su -^^26' ^2c' ^3a) receiver 1: 



nRj: < I{Wi,W2,W3;Y^,g2)+noi\ogp)+oin) 

< Mnlogp + h{g2\Yi)+no{\ogp) + o{n) 

< Mn log p + nR2 + h{Xl^,\X^^, X^) + n o(log p) + o{n) 
■3nR < Mnlogp + nR + h{X^\Xj^,X^) +n o{logp) +o{n) 



(218) 
(219) 
(220) 
(221) 



Similarly if a genie provides Gs = {W3,X2(.) = {X^a^ XJ^^^, X^^, X2c) to receiver 1, we obtain 

3nR < Mnlogp + nR + h{X^\Xj^,X^) + n o{logp) + o{n) (222) 



Adding (217), (221), (222) we have: 



9nR < 3Mn log p + ^uR + n o(log p) + o(n) 



which implies that 



d < 



3M 6 



(223) 



(224) 



B.1.2 Case: Any M/N > 2/3 ^ DoF < ^ 

In this section, consider arbitrary M, N values such that M/N > 2/3. For all such values of M, iV, 
the DoF outer bound that holds is DoF < 3M/5. 
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\Sie\ = {N-M) 
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S2b(N:;b, Nib) 


\S2b\ = J\I - 2{N - M)>0 


o 


S2c{N3b, Nib, Nic) 


\S2c\ = {N-M) 
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S^aiNia, Nib, N2b) 


\S3a\ = {N-M) 
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S3b{Nib,N2b) 


\S3b\ =M-2{N-M)>0 
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SsciNlb, X2b, N2c) 


\S3c\ = {N-M) 



Note that the size of \Xi,\ > N — M and the size of \Sb\ > as indicated above, only because 
M/N > 2/3. 

First, a gcnic provides Qi = {Xsa, X^b, X2b, X2c) to receiver 1. Thus, the total number of 
dimensions available to the receiver 1 (including those provided by the genie) is: 

M + \G\= M+ \Xa\ + 2\Xb\ + \Xc\ = M + N+ \Xb\ > M + N + {N - M) = 2N 

With these (at least) 2N dimensions, the receiver is able to resolve both interfering signals. There- 
fore, once again, we have 



ni?s < I{Wi,W2,W^-Y^,Gi) + no{\ogp)+o{n) 

< Mn log p + h{gi\Y{') + n o(log p) + o{n) 

< Mn log p + h{Xl^„ XI) + h{Xl^^, X^,) + n o(log p) + o(n) 
■ 3ni? < Mn log p + h{X2,X^) + h{Xl\X'^) + n o{\ogp) + o(n) 



(225) 
(226) 
(227) 
(228) 



Second, a genie provides Q2 = (^2,^30) = {^2a^ ^2b-> ■^2ci -^^^a) receiver 1, then the total 
number of dimensions available to the receiver 1 is: 

M + \G\=M + N +\Xa\=M + N + N -M = 2N 

So, 2N dimensions are available, and all interference can be resolved. 



ni?s < I{Wi,W2,W^-Y^,g2) + no{\ogp)+o{n) 

< Mn log p + h{g2\Yi) + n o(logp) + o(n) 

< Mn log p + nR2 + h{X^,\X^^,, X" ) + n o(log p) + o(n) 
^?,nR < Mnlogp + nR + h{X^\Xl',Xl') + no{logp) + o{n) 



(229) 
(230) 
(231) 
(232) 



Similarly if a genie provides ^3 = {W3,X2f.) = {X^^, X^j^, X^^, X2c) to receiver 1, we obtain 

3ni? < Mn log p + ni? + /i(X^|X^,X^)+no(logp) + o(n) (233) 



Adding ^M, (p32l), (pSSl) we have: 



9nR < 3Mn log p + AnR + n o(log p) + o(n) 



(234) 



which implies that 



d < 



3M 



(235) 



B.1.3 Case: Any M/N G [1/2,2/3] DoF < ^ 

In this section, consider arbitrary M, N values such that M/N < 2/3. For all such values of M, N , 
the DoF outer bound that holds is DoF < 2A^/5. 
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5l(X2a,X2fe,^36,^3c) \ \Si\ = M > N - M 
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\X2b\ = N - 2{N -M)<{N -M) 
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iXgftI = N - 2{N -M)<{N -M) 
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iXscI = {N-M) 
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S2{X^a, X3b, Xib, Xic) \\S2\=M>N-M 



S3iXia,Xib,X2b,X2c) \S3\=M>N-M 



Note that the size of \Xb\ < N — M as indicated above, because M/N < 2/3. 

First, a genie provides Gi = {XI}^, XJ}^, {X^^, X^J[2N-3M], X^^, X^^) to receiver 1. Note that 
(Xg^j, X£,)[min(2Ar-3Af,Ar-M)] represents the extra dimensions provided to the receiver so that the 
total number of dimensions is at least 2A^ (the minimum necessary to resolve all interference). This 
is verified as follows. 

The receiver already has M dimensions. The usual genie information Xg^, Xg^^, Xg^, 



stitutes another N + I XI 



con- 

N + 2M — N = 2M dimensions, for a total of 3M dimensions. This 
is still less than 2A^ because M/N < 2/3. So we need another 2A^ — 3M dimensions. So we 
provide any 2N — 3M elements from X2a,X^^, which is the extra genie information indicated as 
{X2a, X^^)[2N-3M]- Thus the total number of dimensions available to the receiver (including those 
provided by the genie) is 2N, and all interference can be resolved. In the outer bound, the extra 
dimensions are directly accounted in the prelog factor and dropped from the conditioning terms 
(which can only increase the entropy terms). 



ni?E < I{Wu W2,W3;Y^^,gi)+n o(logp) + o(n) 

< Mn log p + h{Qi\Y{^) + n o(log p) + n o(log p) + o{n) 

< Mn log p+{2N- 3M)n log p + h{X^,, X^) + h{Xl^^, X^,) + n o(log p) + o{n) (238) 
. 3nR < (M + 2N- 3M)nlogp + /i(X^, X^") + h{X'(^,Xl^) + n o(logp) + o(n) (239) 



(236) 
(237) 
(238) 
(239) 



Second, a genie provides G2 = (W2,XJ}^) = (X^^, Xg^, Xg^) to receiver 1, then the total 
number of dimensions available to receiver 1 is: 

M +\G\ = M + N + \Xa\ = M + N + N - M = 2N 

So, 2N dimensions are available, no extra genie information is needed, and all interference can be 
resolved. 



nR^ < I{Wi, W2,W3;Y{',g2) + n o(logp) + o{n) 

< Mnlogp + h{Q2\Y{^) + n o{logp) + n o(logp) + o(n) 

< Mn log p + nR2 + h{X^jX^„ X^) + n o(log p) + o{n) 
3nR <M + nR + h{X'^'\XJ^, X^) 



(240) 
(241) 
(242) 
(243) 



Similarly if a genie provides G3 = (H^3,X2f,) = (Xg^, Xg^, Xg^, Xg^) to receiver 1, we obtain 

3nR < Mnlogp + nR + h{X^\Xj^,X^) + no{logp) + o{n) (244) 
Adding p39l ), ( [2431 ), ( pii) ) we have 

(245) 



9ni? < (3M + 2X - 3M)n log p + 2n/? + 2nR + n o(log p) + o(n) 

, 2X 

^d< — 



(246) 



B.1.4 Case (X, M) = (5, 4) ^ DoF < f 
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3ci, 



S2ai {X3ai , Xsa, X3b, X3C, Xia, Xib, Xic 



S2a{X3a, X3b, Xib) 



S2c{X3b, Xib, Xic 



S2C1 (Xsa, X3b, Xsc, Xia, Xi;,, Xic, Xi 



S'sai (-^lai , Xia, Xib, Xic, X2a, X2b, X2c) 



S3a{Xla, Xib, X2b) 



S3c{Xlb, X2b, X2c 



S3C1 {Xia, Xib, Xic, X2a, X2b, X2C, X- 



First, a genie provides Qi = (Xg^^ , Xg^, Xg^^, Xg^,, to receiver 1, then we have: 

ni?E <IiWi,W2,W3;Y{',gi) + n o(log p) + o(n) (247) 

< Mnlogp + h{gi\Y^) +n o(logp) +n o{logp) + o(n) (248) 

< Mn log p + h{X^,, X^,) + h{X^,, X^^) + n o(log p) + o(n) 

+^(-'^3ail-'^3a)-'^3b'^3c'^3ci) + H^2ci\^2aii ^2a^ ^2by ^2c) (249) 

3nii: < Mnlogp + h{X^,Xj^) + h{Xj^,X^) + n o(logp) + o(n) 

\x:, XI, x:, XI ) + h{xi \x:^ , x:, x^, x^) (250) 

^ 3ni? < Mn log p + HX^^X^) + h{X^,X^) + /i(X,"^ , X,"JX„", X,", X,") + n o(log p) + o(nl251) 
Second, if a genie provides ^2 = (-'^saj > ^sa' ^2a) ^26' "'^S;' "''^2ci) to receiver 1, then we have: 

< liWi, W2,W3; ^2) + n o(logp) + o(n) (252) 

< Mnlogp + h{g2\Y{') + no{logp) + o{n) (253) 

< Mn log p + /i(X2"„ X^„ X^, ) + h{X^jX^„ X^,) + h{X^,^\X^,, X^, X^,^ ) 

+n o(log p) + o(n) (254) 
3ni? < Mnlogp + /i(X:, X,", X,", X,"J + h{X:\X^,X^, ) + /^(X^JX:, X,", X", X,"J 

+n o(log/9) + o(n) (255) 

^ 3rai? < Mnlog p + nR + h{X^\Xj^, X^) + n o(log p) + o{n) (256) 

Similarly if a genie provides ^3 = (Xg^^ , X£,, Xg^, Xg^, X£j, X£jJ to receiver 1, then we obtain: 

3nR < Mn log p + ni? + /i(X,"|X^, Xn + n o(logp) + o(n) (257) 

Last a genie provides G4 = (X^^^, X2aj , X2(j, X2(,, X2C, X2cJ to receiver 1, we have: 

W2 

nR^ < I{Wi, W2, Ws; YC, Qi) + n o(logp) + o{n) (258) 

< Mn log p + h{Gi\Y^) + n o(log p) + o(n) (259) 

< Mn log p + ni?2 + /i(^3"a J^3a, ^36, ^3c, ^3" , ) + ^ o(log p) + o(n) (260) 
^ 3nR < Mn log p + nR + /i(X^jX^, X^^^, X,'^, X,"^ ) + n o(log p) + o(n) (261) 

and similarly if a genie provides ^5 = (Xg^^, X2c^ , X£j, Xg^, Xg^, Xg^J to receiver 1 then we have: 

V ' 

W3 

3nR < Mn log p + uR + h{X^^\X^^ , X^, X^", X^) + n o(log p) + o(n) (262) 

Finally, adding ( pslj ), ([256]), ( [2571 ), p6l] ), ( [2621 ), we obtain 

15nii < 6ni? + 5Mnlogp + n o(logp) + o(n) (263) 
5M 20 . 



B.1.5 Case: Any M/N > 4/5 



DoF < ^ 



\Xia, \^N-M 


Xlai 


o 


\Xia\^N-M 


Xia 


o 


\Xu\ >N - M 


Xu 


o 


\Xic\ = N-M 


Xlc 


o 


\XicA^N-M 


Xlc-i 


o 



o 


"5*101 {X2ai , X2a, X2b, X2c, X^a, X^b, X^c) 


\SiaA=N-M 


o 


SlaiX2a, X2b, X:ib) 


\Sia\=N-M 


o 


Slb{X2ai J X2a, X2b, X2C, X^^a, X^b, -^3cj X^ci) 


\Sib\ > 


o 


Slc{X2b, X^bi X^c) 


\Sic\=N-M 


o 


Slci {X2a, X2b, X2C, X:ia, -'^36 7 -'^3c7 X^ci ) 


\Sic,\=N-M 



X2ai 





X2a 





X2b 





X2C 





X2C1 









S2ai {Xsai , X^a, X^b, X^c, Xia, Xib, Xic) 





S2aiX3a, X^b, Xib) 










'5'2c(-'^36! Xib, Xlc) 





S2C1 (Xza, X^b, X^c, Xia, Xib, Xlc, Xici ) 



X^ai 





X'ia 





Xzb 





X3,c 





-^^301 









'S'301 {Xia-^ , Xia, Xib, Xlc, X2a, X2b, X2c) 





S3a{Xia, Xib, X2b) 





Ssb 





S^dXib, X2b, X2c) 





"5*301 (-^^107 -''^167 Xlc, X2a, X2b, X2C, -^^201) 



All genies work exactly as in the (A^, M) = (5, 4) case. Re-write the same equations, substituting 
M instead of 4 in each of ( [251] ), p^ , ( p57| ), ( [26T| ), p62| ), so that we obtain the bound: 

5M 
~9~ 



R < 



B.1.6 Case: Any M/N € [3/4,4/5] => DoF < 



4Af 
9 



\Xiai\=N-M 


Xlai 


o 


\Xia\=N-M 


Xia 


o 


\Xu\ <N-M 


Xib 


o 


\Xic\ = N -M 


Xlc 


o 


\Xici\=N-M 


Xlci 


o 



o 


'S'lai {X2ai 7 X2a, X2b, ^2c7 X^a, X^b, ^3c) 


\Siai\=N-M 


o 


Sl{X2a, X2b, X2c, X^a, X^b, -^3c) 


\Si\ >N-M 


o 


'S'lci (-^2a7 X2b, X2c, X^a, X^b, X^c, X^ci) 


\Sic,\=N-M 



X2ai 


o 


X2a 


o 


X2b 


o 


X2c 


o 


X2ci 


o 



'S'2ai (-^^301 7 -^3a7 -^^36 7 -^3c7 Xia, Xib, Xlc 



S2 



S2C1 {X^a, X^b, X^c, Xia, Xib, Xlc, Xi. 



Cl, 



Xl,ai 









Xza 










5'3ai {Xla-i 7 Xia, Xib, Xlc, X2a, -^26, X2c) 


Xzb 










S3 


X^c 










S3C1 (-^^10 7 -^167 Xlc, X2a,X2b, X2c, X2C1) 


-^3ci 










Once again, only Genie 1 needs extra dimensions. Precisely an additional 4A^— 5M extra dimensions 
are needed, so that in place of (251) we get 

3nR < {M + 4N-5M)nlogp + h{X:,Xn + h{Xl\X:) + h{Xl,Xl\X:,Xl\X^) 

+n o(logp) + o(n) (265) 

The remaining genie bounds remain unaffected. Adding the corresponding bounds as before we 
obtain: 



15ni? < {AN - 5M + 5M)nlog p + 6nR + n o{log p) + o{n) 
AN 



(266) 



B.1.7 Case: (iV, M) = (2L + 3, 2L + 2) ^ DoF < 



XlaL 


O 




o 


Xlaj 


o 


Xla„ 


o 


Xlbo 


o 


^lC() 


o 


Xlci 


o 




o 


XlCL 


o 



o 


SlaLiX2aLr ■ ■ )^2cL_n-'^3ai_i! • • • ^-'^Scl-i) 


o 




o 


Slai {X2ai , X2ao , -'^2bo ' ^200 ) X^ao , X^Ijq , X^cq ) 


o 


5*100 {X2ao 5 X2bo ' Xsbo ) 


o 


'S'lco {X2bo ) Xsbg , Xsco ) 


o 


5*101 iX2ao ) -^^260 > X2C0 5 ^3ao > ^36o ' X3C0 , X^ci ) 


o 




o 


5*10^ {X2aL-i ' ■ • • ) -'^2ci,_i , ^3ai_i , " " " -^^30^ ) 



^2ai 










-^^201 





X2ao 





X2bo 





X2C0 





X2C1 










X2CL 









S2aL (Xsql r • • ) XscL_-^ , Xia^_-^ , • " " > -^^Ic^.i ) 










5*201 (^3ai , X^ao , -^3bo ' X^cq , Xia^ , Xifeg , Xi^q ) 





5*2ao {X^ao , X^hg , Xijjg ) 





5*2co (-^3bo ' "'^l^'o ' ^Ico ) 





52ci {Xsao ) -'^Sfto ' XscQ 5 -'^lao ) -'^Ifeo ' ^Ico ' ^Ici ) 










5*2cL (^3oL_i , • • • ) X3cL_-^ , ^laL_i , • • • -^Ici ) 



-^3az, 










Xsai 





Xsao 





Xsbo 





X3C0 





Xsci 










XSCL 









5*3ai 










5*3ai 





5*300 





53c(, 





5*3ci 










5*30^ 



The rigorous proof for the general case is similar to that shown in Section 5. For brevity, we 
only provide the genie signals and show the bounds that we eventually obtain, and all of them are 
easily to check. 

First, a genie provides Gi = {X^;^^, • • • , -^^sfeg > -^^260 ' ' ' ' ' -^Scl^ to receiver 1, and we obtain: 



3nR < Mnlogp + h{X:^,X^J + h{X^^,X^) + Y.f'(K^K\^-?-rr-- ^KJ 

i=l 

+n o{logp) + o{n). (268) 



Second, if a genie provides 02 = {X^^^, ■ ■ ■ ,X^^^,X^^^, ■ ■ ■ ,X^^J and Qs = {X^^^, ■ ■ 
X^^^, ■ ■ ■ ,X^^^) to receiver 1, respectively, we eventually obtain: 

6nR < 2Mnlogp + 2ni? + M^:jX,"„,X«J + MX-jX-,X,-) + no(log/,) + o(n 

Third, if a genie provides ^4 = {X^ar.^ ' ' ' ^^Sa.^^Sa.r ■ ■ ,^2" J and ^5 = (^2"^, • ■ 
Xg^^ , • • • , -^3ai, ) *o receiver 1 , respectively, we eventually obtain: 

6nR < 2Mnlogp + 2nR + h{Xl,X^^\X2„X^^,Xl) + noilogp) + oin). 



Last, if a genie provides a2L+2 = {X^a^ ' ^Sxl ' " " ' ' ^2cz, ) ^nd g2L+3 = (Xg^ , , • ■ 
to receiver 1, respectively, we eventually obtain: 

6nR < 2Mnlogp + 2nR + hiX:^,X:^\X:^_^,... ,Xl_J + noilogp) + oin). 

Adding all the outer bounds, we have: 

3(2L + 3)nR < {2L + 3)Mn log p + {2L + A)nR + n o(log p) + o(n) 
(2L + 3)M 



d < 
d < 



4L + 5 
MN 

M + N 

2-^+2 A/T/Ar 2L+2 



And the bounds for M/N < |^ and M/N > |f±| follow similarly as well. 

B.2 Outerbound Proofs around M/N ratios 3/4, 5/6, • • • 
B.2.1 Case (TV, M) = (4, 3) DoF < f 



Xlai 





Xiao 





Xico 





Xlci 







X2ai 





^2ao 





^2co 





X2C1 







Xsai 





X3ao 





^3c„ 





Xsci 






'S'lao (A^2ai ) X2ao i ^2co ) X^ao , X; 



3co) 



Slbo{X2ao,Xsco) 



° Slco (^2ao ) X2C0 ' ^3oo ) Xsco , Xsci ) 



'S'2ao {X^ai , X^ao ) X^cq , Xiag , Xicq ) 



S2C0 i-^Sao ) X3C0 ) XiaQ , Xico ' ^Ici ] 



'S'sao (^lai ) XiaQ , ^Icq ) -^^200 ) ^2co ) 



'S'3bo(-'^lao>-'^2co) 



O S3C0 {Xiao 5 -'^Ico 5 ^2oo ) -^^200 ) -^^201 ) 



First, a genie provides Qi = {X^ai^ -^Eao^ ■^2aQ^ -^2co' -^2ci) receiver 1, then we have: 
ni?E < Mnlogp + h{X^,^,XlJ + hiXljXSJ+no{logp)+oin) 

+H^2ci I -^^201 ) ^2ao ' ^2co ) + H^3ai I ^3ao ' ^3co ' ^3ci ) (275) 

^3nR < Mnlogp + h{Xl,X:}^) + h{X:^\X^J + no{logp) + o{n) 

+h{X:}^\X:^,Xl,X^J + hiX^jX2„X^^^,Xl) (276) 

< Mnlogp + + hiXllX^J + +n o(logp) + o(nl277) 

< Mnlogp + nR + + n o(logp) + o(n) (278) 

Similarly if a genie provides G2 = (-'^zci > ^2co ' "^3co ' "^3ao > "'^Sai ) to receiver 1, we have: 

3nR < Mn log p + nR + h{X^^^ \X^J + n o(log p) + o(n) (279) 



Adding up ( |278[ ) and ( |279[ ) we have: 

6ni? < 2Mn log /) + 2ni? + h{X^^ , X^^^ ) + n o(log p) + o(n) (280) 
Second, if a genie provides = (-'^saj , -^^201 > ^2ao ' "'^Zco ' "^^201 ) receiver 1, then we have: 

^ V ' 

W2 

nRj: < Mnlogp + nR2 + h{Xl'jXl',^,Xl^,X^,J + no{logp) + o{n) (281) 
^3nR < Mn log p + ni? + /i(X^jX^^,X,"^,X,"J + no(logp) + o(n) (282) 



and similarly if a genie provides ^4 = {X2c-^^, X^^_^, X^^^, X^^^, X^^_^) to receiver 1, then we have: 

V ' 

3nR < Mnlogp + nR + h{X^^\X^^,X^^,X^J + no{logp)+oin) (283) 



Thus, we have: 



6nR < 2Mnlogp+2nR + h{X^^,Xl\X-;^^,Xl)+no{logp) + o{n) 



Adding (280), (284), we obtain 



12ni2 < AMnlogp + 'inR + nR + n o{logp) + o{n) 
4M _ 12 



d < 



(284) 

(285) 
(286) 



B.2.2 Case {N, M) = (6, 5) ^ DoF < f5 



^la2 





Xlai 





Xlaa 





^Ico 





^Ici 





XlC2 







X2a2 





X2ai 





^2ao 










^201 





^202 







X3a2 





^Sai 















X:ic^ 





X3C2 






Co; 



Slco {X2ao 1 X2C0 , X^ao , X^co > X: 



3ci , 



Slci (^2ai ) -^^200 ' X2C0 5 ^2ci ) -^^301 ; X^ao j -^3co ) ^3ci ; -^^302 ) 



S2ai {X3a2 ) -^3ai j -^^300 ) ^3co ) -^^301 , Xia^ , Xia^ , Xicq , Xi 



'S'2ao {Xsai ) ^Sao ) -^^300 ) Xiag , Xicg ) 



5*260 ("^3ao ) -'^l 



Co; 



5'2co (-^^300 ) -'^3co , XiaQ , Xicg , Xic-^ ) 



'S'2ci ("'^3ai ) -^^300 ) -'^Sco ) -^^301 ) Xia^ , Xiao ' "^Icq ) ^Ici , Xic^ ) 



Ssai {Xla2 ; ^lai j ^lao ) -'^Ico ) Xic^ , X2ai ' ^2ao ) ^2co ) ^2ci ; 



5'3feo(-^lao'-'^2co 



Ssco {Xiao 1 Xlco ) -^^200 5 X2co , X2C1 ) 



'S'3ci {Xlai ) Xiao ' ^Ico ) Xic^ , X2ai ) -^^200 , -^2co ; -^^201 ; -^^202 ) 



First, a genie provides Gi = {X^a2^ XI}^^, X^^^, X^^^, X^^^, X^^^, X^J to receiver 1, then we 
have: 



nRj: < Mn log p + h{X^,^ , X^^ ) + h{XS,^ \X^,^ ) + n o(log p) + o(n) 

+"l^2cil-^2ai>-^2ao'-^2coJ + "l^Sai |-^3ao ' ^3co ' -^3ci J 

I ji/'v^ I V" ^ I ufVfT- IV" v" v" v" v" ^ 

+"1^2C2 1^202 ' ^2ai : ^2ao ' ^2co : ^2c J + "l^3a2 I^Sai J ^3ao ' ^3co ' ^3ci 1 -^3c2 J 

^ 3ni? < Mn\ogp+h{Xl,Xl) + h{X:jXl) + hiX^lX^^, X^, X^J + hiX^^lX^, X^, X^) 
+h{Xl \Xl^ , Xl^ , XI , XI , XI ) + h{X:^ \X:^ , X:^ , Xl , Xl , Xl ) + n o(\og p) + o{n) 

< Mn log p + h{X2^ , XI ) + h{X2^ \Xl ) + h{X:^ , XI \X:^ , X^ 
+n o(logp) + o(n) 

< Mn log p + nR + /i(X„JXco ) + n o(log p) + o{n) 



U I V" V" I V" V" V" 

'*l-^a2 ' ^C2 l^ai I ^ao ' ^co ' 



(287) 

(288) 

(289) 
(290) 



Similarly if a genie provides ^2 
have: 



i V^ V" V' V" 

V^2c2 ' ^2ci ' ^2co ' ^3co ' ^3ao ' 



3ni? < Mn log p + ni? + /i(X^;, jX^^) 



X£j^,X£j2) to receiver 1, then we 
+ n o(log/9) + o(n) (291) 



and thus we have: 



<QnR < 2Mn log p + 2nR + h{X2^ , X^J + n o(log p) + o{n) 



(292) 



Second, a genie provides ^3 = (^Itaa ' ^3ai ' ^2ai ' ^2ao ' ^S^o ' ^2ci > ^2c2 ) receiver 1, then we 
have: 

nRj: < Mnlogp + M^2ai,^2ao,^2co>^2\,^2"J + ^o(logp) + o(n) 

+H^3ai I ^3ao ' ^Scq ' ^3ci ) + K^3a2 I ^3ai ' ^3ao ' ^3co ' -^3ci ' ^3c2 ) C^^^) 

-^3ni? < Mn\ogp + h{Xl,Xl,Xl,Xl,X^^)+no{\ogp) + o{n) 

+^(^ai l^ao ' ' -^ci ) + ^(^"2 1^01 ) ' ' -^ci > -'^S ) (294) 

^3nR < Mn\ogp + nR + h{X2,\X2„X^^,Xl) + no{\ogp) + o{n) (295) 

Similarly if a genie provides ^4 = {X^^^, X^^^, Xl}^^, X£^, X^^^, XI}^^, X^^^) to receiver 1, then we 
have: 

3ni? < Mnlogp + ni? + /i(X,"jX;\,X;;,X;;) + n o(logp) + o(n) (296) 
and thus we obtain: 

6nR < 2Mnlogp + 2nR + h{X^^,Xl\X2^,Xl)+no(logp)+o{n) (297) 

Last, a genie provides ^5 = (^£,2 ' ^2^02 > ^2"ai > ^2ao > ^2"co > ^2™! , ^2c2 ) receiver 1, then we have: 

W2 

ni?s < Mn log p + nii2 + HX^,^ \Xl_^ , , Xl\^ , Xg^ , Xg",^ ) + n o(log p) + o{n) (298) 
-^3ni? < Mnlogp + nR + h{Xl\Xl,X2^,X^^,Xl,X^^) + no{logp) + o{n) (299) 

Similarly if a genie provides = {X^^^,X^^^,XS^^,X^^,X^^^,X^^^,X^^^) to receiver 1, then we 
have: 

3ni? < Mn log p + ni? + ^(X-|X-,X-,X-,X^,X,"J + no(logp) + o(n) (300) 
and thus we have: 

6nR < 2Mn\ogp + 2nR + hiX2„Xl\Xl,X2„X^^,X^J+no{logp) + oin) (301) 
Adding the final equations from each of the genies, we obtain: 

18nR < GMnlog p + 6nR + nR + n oilog p) + o{n) (302) 

6M 30 , , 

d < ^ = yj (303) 



B.2.3 Case {N, M) = (2L + 2, 2L + 1) ^ DoF < 























^Ico 





Xlci 
































^2ao 





^2co 





X2C1 










^2CL 









'S'lai-i {^2aL ) ■ • • ) ^2cL-i > ^3aL-i T ' ' ; ^Scl-i ) 










'S'lao {^2ai , X2ao > -^2co ) ^3ao j ^3co ) 





'S'lbo("'^2ao) -^3co) 





'S'lco (-^^200 ) ^2co ) ^3ao j -^3co > ^3ci ) 










SlcL_i {^2aL-i > • • • , X2CL-1 ' ^SoL-i ' ■ ■ ■ ! ^3cl) 







S2aL_x{XzaLn, ■ ■ ■ , X3cl-i^ ^laL-i^ ' ' , ^Icl-i) 










S2ao {X3ai , -^Sa,) , -^3c() , Xia„ , Xic„ ) 










'S'2co (^3ao ) ^3co ) ^loo i -^Ico > ^Ici ) 










'S'2cz,_i (-'^3ai_i , • • • 5 ^ScL-i 5 ^IflL-i ) ■ • • ) -^Ici) 



X3aL 










X3ai 










^300 
























S3a„-i {^laL ) ■ • • ! ^IcL-i ) -^^20^-1 ! • • • 












'S'3ao (^lai 5 XiaQ , ^Ico ) -^^200 j ^2co ) 










'S'3co i-^lao ) ^Ico ) -^2oo i -^^200 > ^201 ) 










'S'3cz,_i (-'^lai.i , • • • 5 ^IcL-i ) ^2ai_i , " 


■ ■ >^2cz,) 



First, a genie provides = ^ , • • • , Xg" ^ , , • • • , X^^^ ) and ^2 = (^2"^ , • • 
jXg^^) to receiver 1, respectively, and we eventually have: 

6nR < 2Mn log p + 2nR + h{X2^^ , X^^ ) + n o(log p) + o(n) . 

Second, a genie provides ^3 = (Xg^^ , • • • , Xg^^ , XJ^^^ , • • • , Xg.^ ) and ^4 = (^201, > • • 
,X3„^) to receiver 1, respectively, and we eventually have: 

6ni? < 2Mn log p + 2nR + h{X2^ , X,"^ , X,"^ ) + n o(log p) + o(n) . 



vn vn 

■ '^2co'^3co' 

(304) 

vn vn 

■ '^2ci'^3ci' 

(305) 



Last, a genie provides g2L+i = {X^,, , X^, ^ , • • • , Xf,^ ) and g2L+2 = {X^c, , ^3c, r • • , ) 
receiver 1, respectively, then we eventually obtain: 



6nR < 2Mnlogp + 2nE + /i(X;'^,X,"jX^^_^,--- ,X,"^_J + no(logp) + o(n). (306) 



Adding the final equations from each of the genies, we obtain: 



6{L + l)nR < 2{L + l)Mnlogp + 2{L + l)nR + nR + no(logp)+o{n). (307) 
(2L + 2)M MN 



d < 



4L + 3 



M + N 



(308) 



B.2.4 Case M/N > (2L + 1)/(2L + 2) ^ DoF < ^^^j^ 
The proof is identical to the previous section. 



{2L+1)N 



B.2.5 Case M/N G [2L/(2L + 1), (2L + 1)/(2L + 2)] DoF < 

This setting is also simple, but needs a small manipulation in the size of Xay,XcQ (the two cannot 
be equal) if N is not even. As always: 



\Xa,\ = \Xc,\=N -M, ViG{l,---,L} 
In this case, if N is not even, let us choose 

'N-2L{N- M)' 



X, 



\X. 



col 



so that 



N - 2L{N - M) 



N - 2L{N - M) 



(309) 

(310) 
(311) 



Only Genie 1 needs to provide extra dimensions. The Genie usually includes two symmetric 
cases, one that provides two terms of the form \Xa^\ and another that provides two terms of the 
form |Xcg|. Because the two have different sizes, the two genies usually involved within Genie 1, 
are no longer symmetric. 

The number of extra dimensions needed for the Genie that provides two terms of the form | Xa^ \ 

is 



{N-M)-\Xa,\ 

so that the corresponding bound instead of ( |278 ) is 



(312) 



^nR < [M+{N-M)]nlogp-\X^\+h{X^\X^)+noilogp) + o{n) 



Similarly, the corresponding bound instead of (279) is 



3nR < [M + (iV - M)]n log /> - | + /i(X" ) + n o(log p) + o(n) 



(313) 



(314) 



and the resulting bound instead of (280) is 



6nR < [2M + 2{N-M)-N + 2n{N-M)]nlogp + h{X^^,X^) + no{logp) + o{n){3l5) 



Thus, adding the bounds from ah the genies, instead of (307) we get 



6{L + l)nR < 2{L + l)Mnlogp + 2{L + l)nR + nR + n o{logp) + o{n) 

+ [2{N - M) - N + 2L{N - M)]nlogp (316) 
6{L + l)nR < 2{L + l)nR + nR+{2L + l)Nnlogp + no{logp) + o{n) (317) 

(2L + 1)N , , 

< ' . 318 
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